[2025-04-21 14:08:09.867520] INFO New syslog file info: [address: "11.29.122.182:2882", observer version: OceanBase_CE 4.3.4.1, revision: 101000032024121814-50c70ec9b4360352607cbed6587000307b82694e, sysname: Linux, os release: 4.19.0-91.82.179.3.uelc20.x86_64, machine: x86_64, tz GMT offset: 08:00] [2025-04-21 14:08:09.867333] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=723] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:09.867509] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=28] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65601583}, readable_log_tail:{lsn:65601583}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1503185, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:09.867659] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=148] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:09.867714] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=27] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:09.869574] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFF5-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254895419881, cache_obj->added_lc()=false, cache_obj->get_object_id()=616, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:09.877861] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=9, gc_interval=10000000) [2025-04-21 14:08:09.877982] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=70] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:09.878034] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=39] gc_check_member_list_ cost time(ret=0, time_us=100) [2025-04-21 14:08:09.878076] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=31] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:08:09.878114] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=26] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:09.878152] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=31] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:09.878187] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=30] execute_gc cost time(ret=0, time_us=37) [2025-04-21 14:08:09.878242] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=50] ObSafeDestroyHandler start process [2025-04-21 14:08:09.879379] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:09.879448] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1578, avg_log_submit_to_slide_time=1605) [2025-04-21 14:08:09.887812] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=74] finish to resize log external storage handler(current_ts=1745215689887806, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:09.904662] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDB8-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215689904637}) [2025-04-21 14:08:09.904728] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDB8-0-0] [lt=44] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215689904722}) [2025-04-21 14:08:09.904739] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCD-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215689904706, sql_renew_time:1745215689904706, is_mark_fail:false}]) [2025-04-21 14:08:09.904810] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCD-0-0] [lt=69] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215689904637}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215689904706, sql_renew_time:1745215689904706, is_mark_fail:false}]) [2025-04-21 14:08:09.904854] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCE-0-0] [lt=32] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:09.905260] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCE-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215689905247, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:09.905291] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCE-0-0] [lt=30] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215689904722}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215689905247, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:09.906329] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDB8-0-0] [lt=16] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:09.911858] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=35] ls blacklist refresh finish(cost_time=8524) [2025-04-21 14:08:09.918596] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:09.919076] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14088, max_lsn:65602290, max_scn:{val:1745215689899610000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65602290}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65601705}, last_submit_end_lsn:{lsn:65602290}, last_submit_log_id:14088, last_submit_log_pid:3, max_flushed_lsn:{lsn:65601705}, max_flushed_end_lsn:{lsn:65602290}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65602290}, last_slide_log_id:14088, last_slide_scn:{val:1745215689899610000, v:0}, last_slide_lsn:{lsn:65601705}, last_slide_end_lsn:{lsn:65602290}, last_slide_log_pid:3, last_slide_log_accum_checksum:48654742, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14089, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65602290}, readable_log_tail:{lsn:65602290}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1502478, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:09.919322] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=240] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215689902085, last_flushed_end_lsn:{lsn:65602290}}]) [2025-04-21 14:08:09.919347] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14089, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215689902085, last_flushed_end_lsn:{lsn:65602290}}]) [2025-04-21 14:08:09.924276] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:09.926124] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215689925520000, start_id=1745215689925520000, end_id=1745215689925520001) [2025-04-21 14:08:09.935273] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:09.935322] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:09.944597] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=51] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:09.952517] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=35] current monitor number(seq_=-1) [2025-04-21 14:08:09.953525] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:09.953617] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:09.953654] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:09.953686] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:09.953713] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:09.955108] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1694, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:09.955164] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:09.955205] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:09.955244] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:09.955285] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1855, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:09.955310] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:09.955348] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:09.955367] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1737, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:09.967296] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=91] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43613601792, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:09.970759] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:09.989572] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=104] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8375) [2025-04-21 14:08:09.995173] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDCB-0-0] [lt=52] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:09.995258] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDCD-0-0] [lt=39] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:09.998315] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:10.002223] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=103] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8964, avg_group_log_size=498) [2025-04-21 14:08:10.006513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:10.018669] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.019154] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=38] LogLoopThread round_cost_time(us)(round_cost_time=332) [2025-04-21 14:08:10.027074] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=47] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:10.029505] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:10.043890] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=57] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:08:10.045231] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=541044736, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=532697088, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:10.045333] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=62] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:10.045369] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=123, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:10.045441] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=654008320, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=419733504, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:10.045509] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:10.045532] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=7, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:10.054644] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=14558208) [2025-04-21 14:08:10.054708] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.055225] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:08:10.061082] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:10.100660] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:10.100726] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:10.101944] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1428, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:10.102042] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:10.102086] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1567, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:10.102110] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:10.102008] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:10.118743] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=80][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.153748] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:10.164940] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCB-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:10.165024] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCB-0-0] [lt=80] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:10.167856] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43613601792, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:10.184198] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=25] worker thread began to shrink(tenant_->id()=1001, group_id_=20, token=0) [2025-04-21 14:08:10.191347] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8375) [2025-04-21 14:08:10.191492] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8375) [2025-04-21 14:08:10.191574] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1499, avg_log_submit_to_slide_time=1519) [2025-04-21 14:08:10.191626] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:10.191683] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8375, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:10.192335] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [621759][T1001_L0_G20][T1001][Y0-0000000000000000-0-0] [lt=71] worker thread exit(tenant_->id()=1001, workers_.get_size()=1) [2025-04-21 14:08:10.192384] INFO [SHARE] end_run (ob_tenant_base.cpp:334) [621759][T1001_L0_G20][T0][Y0-0000000000000000-0-0] [lt=41] tenant thread end_run(id_=1001, ret=0, thread_count_=133) [2025-04-21 14:08:10.204135] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215689647824003, v:0}, new_max_version={val:1745215689647824003, v:0}, last_min_version={val:1745215689647824001, v:0}, last_max_version={val:1745215689647824001, v:0}, total_time_us=3148, delta_us=556307) [2025-04-21 14:08:10.204196] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215689647824003, v:0}, min_version={val:1745215689647824003, v:0}, max_version={val:1745215689647824003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:10.206640] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:10.215293] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:10.215362] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:10.215559] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:10.215769] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:10.215858] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:14, schedule:38, submit:9, rt:1353, total:1415) [2025-04-21 14:08:10.215934] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:10.215999] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:14, schedule:38, submit:9, device:1353, total:1415) [2025-04-21 14:08:10.216062] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:10.216148] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:857, total:873) [2025-04-21 14:08:10.216226] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:10.216263] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:857, total:873) [2025-04-21 14:08:10.216323] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:10.216351] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:10.218813] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.221462] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFDFE-0-0] [lt=25] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:10.221532] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFDFE-0-0] [lt=67] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:10.230949] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=54] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:10.251849] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:10.253164] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:10.253269] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215681136928000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:10.253843] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=139] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:10.279250] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=520] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4080) [2025-04-21 14:08:10.279434] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4080, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:10.318886] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.347521] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1745215690347515, bytes: 4085122, bw: 0.012555 MB/s, add_ts: 1007619, add_bytes: 13265 [2025-04-21 14:08:10.353918] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:10.355598] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:10.356640] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:10.356692] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.368349] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43611504640, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:10.391449] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=90] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1405, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:10.391519] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:10.391594] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:10.391634] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1536, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:10.398853] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:10.399122] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:10.399172] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:10.406779] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:10.406783] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1745215690406778, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2025-04-21 14:08:10.414881] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=93] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:10.417124] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:10.418952] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.420419] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:10.420470] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:10.420488] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:10.420515] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:10.420544] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254894970639, flush_io_finished_ret_:0, flush_io_finished_round_:82, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:10.424301] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=50] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:10.435447] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:10.435506] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.446314] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3951, offset=41607}, end_cursor:ObLogCursor{file_id=3, log_id=3952, offset=41913}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c78784050, len:3449, log_data_len:306, seq:3951, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:10.446726] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE30-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:10.446803] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE30-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215690148905002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215690148905002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:10.450724] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE30-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215690449938000, start_id=1745215690449938000, end_id=1745215690449938001) [2025-04-21 14:08:10.454075] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=66] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3952, offset=41913}, end_cursor:ObLogCursor{file_id=3, log_id=3953, offset=42210}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c78788050, len:3143, log_data_len:297, seq:3952, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:10.454419] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE30-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:10.454485] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE30-0-0] [lt=36] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215690148905003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215690148905003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:10.461540] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=79] ====== tenant freeze timer task ====== [2025-04-21 14:08:10.475886] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=68] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.476123] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.477156] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.477213] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.479869] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=71] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:10.480760] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=44] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:10.482017] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:10.482118] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215685534563000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:10.500989] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4078, avg_group_log_size=370) [2025-04-21 14:08:10.501059] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4080) [2025-04-21 14:08:10.519032] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.554863] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:186) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict mem start(request_manager_->get_tenant_id()=1002, evict_low_mem_level=0, evict_high_mem_level=16106127, size_used=0, mem_used=16637952) [2025-04-21 14:08:10.555796] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:10.555848] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1667, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:10.555863] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=72] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=2, elapse_time=1001, size_used=0, mem_used=0) [2025-04-21 14:08:10.555907] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=35] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.555921] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:10.563324] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:10.563376] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:10.568510] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:10.568838] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43628281856, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:10.571918] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:10.571968] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:10.571987] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:10.572016] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:10.572042] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254895122148, flush_io_finished_ret_:0, flush_io_finished_round_:82, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:10.585973] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:10.600368] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:10.600422] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:10.602171] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:10.602207] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:10.606907] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:10.619106] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.649815] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:10.650149] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=62] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215690650134], gts:1745215690649977000, latest_srr:[mts=1745215690650134]}) [2025-04-21 14:08:10.656012] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:10.656092] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1773, avg_log_submit_to_slide_time=1788) [2025-04-21 14:08:10.656051] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17293372, this={dio_aligned_buf:{buf_write_offset:182, buf_padding_size:3914, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:1908, truncate_used_ts:686}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17293312, buf_len=122, total_write_size=13963, total_write_size_after_dio=434176, ob_pwrite_used_ts=258763, count=102, each_pwrite_cost=2536) [2025-04-21 14:08:10.656167] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1823, avg_log_submit_to_slide_time=1843) [2025-04-21 14:08:10.656140] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:10.656199] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:10.664603] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2025-04-21 14:08:10.664652] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=63154580, tenant_id=1002) [2025-04-21 14:08:10.664707] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:10.695327] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.695390] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.695424] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.695699] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.695748] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.695982] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.696051] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.696097] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.696217] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.696283] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.696306] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:10.715849] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=66] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:10.719186] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.720303] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=28] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:10.720347] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=43] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:08:10.720367] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:10.720389] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=19] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:10.769329] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:10.783795] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:10.799817] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFEEC-0-0] [lt=42] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.106010627746582031e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=405, Throttle Trigger(MB)=243, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.508995856345900393e+02) [2025-04-21 14:08:10.801580] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFDFE-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:10.801656] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFDFE-0-0] [lt=73] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:10.807049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:10.817163] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:08:10.817182] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=36] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:10.817230] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=38] temporary file module use no blocks [2025-04-21 14:08:10.817247] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:10.817268] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:10.817298] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=29] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254895367417, flush_io_finished_ret_:0, flush_io_finished_round_:82, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:10.819268] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.824392] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:10.856810] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:10.856874] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.872893] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFF7-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:10.875378] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFF7-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254896425685, cache_obj->added_lc()=false, cache_obj->get_object_id()=617, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:10.879910] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4077) [2025-04-21 14:08:10.879992] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1500, avg_log_submit_to_slide_time=1524) [2025-04-21 14:08:10.880057] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AEFFF1-0-0] [lt=27] [APPLY STAT CB APPEND COST TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=55, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:10.880089] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AEFFF1-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1797, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:10.880110] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AEFFF1-0-0] [lt=19] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:10.880128] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AEFFF1-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-561, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:10.880147] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AEFFF1-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1291, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:10.903267] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=43] LogLoopThread round_cost_time(us)(round_cost_time=32) [2025-04-21 14:08:10.919351] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:10.935654] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:10.935715] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:10.954383] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:10.954473] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:10.954511] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:10.954543] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:10.954572] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:10.956014] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1678, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:10.956083] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:10.956079] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:10.956146] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:10.956192] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1774, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:10.956241] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:10.956262] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1847, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:10.956283] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:10.969808] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:10.990319] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=71] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8381) [2025-04-21 14:08:10.997395] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:10.997437] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=42] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:10.997459] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA7-0-0] [lt=21] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:10.997531] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA7-0-0] [lt=64] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:10.999335] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=89] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:11.001054] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:11.003022] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8381, avg_group_log_size=493) [2025-04-21 14:08:11.005844] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=43][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:11.007190] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:11.019419] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.026585] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=85] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:11.026735] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=46] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:11.029627] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:11.037538] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=30] === Run print tenant memory usage task === [2025-04-21 14:08:11.037617] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=37] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 133,316,608 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 776,400,896 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,691,036,807 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,070,678,016 max_mem_memstore_can_get_now= 2,465,120,256 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,691,036,807 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,773,200 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 541,044,736 max_mem_memstore_can_get_now= 363,866,066 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,691,036,807 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,944,860 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 641,425,408 max_mem_memstore_can_get_now= 314,724,314 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:08:11.037710] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=26] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,180,355,584 total_hold= 3,351,248,896 used= 3,094,167,552 freelists_hold= 86,188,032 total_maps= 1,203 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,866,267,648 divisive_memory_used= 133,316,608 virtual_memory_used= 4,553,916,416 [CHUNK_MGR] 2 MB_CACHE: hold= 37,748,736 free= 18 pushes= 300,617 pops= 300,599 maps= 1,069 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 79 pops= 77 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:08:11.037759] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 3082, delta_count= 2, avg_cost_time= 1541 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:08:11.044081] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=72] worker thread began to shrink(tenant_->id()=1002, group_id_=20, token=0) [2025-04-21 14:08:11.047564] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] [COMPACTION DAG STATUS] (start_time=1745215681045326, end_time=1745215691047561, dag_status={}) [2025-04-21 14:08:11.047618] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=49] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047641] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047656] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047694] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047713] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047733] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:11.047788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047833] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047870] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047945] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047968] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.047988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048006] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048068] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048086] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048122] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048141] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048187] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048210] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048230] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048262] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048283] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048344] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048398] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048435] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048453] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048470] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048560] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048578] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048616] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048635] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048654] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048716] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048752] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048769] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048840] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048882] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048899] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048916] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048934] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048952] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048970] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.048987] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049022] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049074] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049090] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049137] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:11.049175] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:11.049193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:11.049211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:11.049227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:11.049239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:11.049250] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:11.049266] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:11.049282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:11.049298] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:11.049314] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:11.049331] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:11.051663] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [621915][T1002_L0_G20][T1002][Y0-0000000000000000-0-0] [lt=68] worker thread exit(tenant_->id()=1002, workers_.get_size()=1) [2025-04-21 14:08:11.051713] INFO [SHARE] end_run (ob_tenant_base.cpp:334) [621915][T1002_L0_G20][T0][Y0-0000000000000000-0-0] [lt=41] tenant thread end_run(id_=1002, ret=0, thread_count_=151) [2025-04-21 14:08:11.052100] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD8D-0-0] [lt=47] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:08:11.056034] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:11.056086] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.056290] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:11.081091] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:11.081148] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=51] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:11.081168] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:11.081194] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:11.084376] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:11.084656] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=276] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:11.085199] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=110] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:11.090407] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:11.092331] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD96-0-0] [lt=53] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=92) [2025-04-21 14:08:11.092641] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1745215691092333000, start_id=1745215691092333000, end_id=1745215691092333001) [2025-04-21 14:08:11.101088] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:11.101149] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:11.102015] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] success to update min reserved snapshot(reserved_snapshot=1745213881136928000, duration=1800, snapshot_gc_ts=1745215681136928000) [2025-04-21 14:08:11.102424] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1395, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:11.102479] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:11.102546] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:11.102601] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1544, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:11.102640] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:11.104788] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8707096, this={dio_aligned_buf:{buf_write_offset:3208, buf_padding_size:888, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2213, truncate_used_ts:949}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8704000, buf_len=112, total_write_size=13537, total_write_size_after_dio=425984, ob_pwrite_used_ts=246060, count=101, each_pwrite_cost=2436) [2025-04-21 14:08:11.104985] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=60] update reserved snapshot finished(cost_ts=2977, reserved_snapshot=1745213881136928000) [2025-04-21 14:08:11.119503] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.133607] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=39] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:08:11.134963] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=53] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:08:11.135006] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=39] no transfer partition job [2025-04-21 14:08:11.135026] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:08:11.137571] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=26] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:08:11.137634] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=48] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:08:11.137675] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8D-0-0] [lt=35] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:08:11.150410] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=35] ts response task statistics(alloc_count=1734, free_count=866) [2025-04-21 14:08:11.166833] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCC-0-0] [lt=23] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:11.166892] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCC-0-0] [lt=56] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:11.170320] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:11.179438] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=9000000, clean_num=200000) [2025-04-21 14:08:11.200855] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9364) [2025-04-21 14:08:11.200962] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9364) [2025-04-21 14:08:11.201052] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1433, avg_log_submit_to_slide_time=1452) [2025-04-21 14:08:11.201093] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:11.201138] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9364, hit_cnt=19, read_cnt=19, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:11.201764] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=41] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215690649977003, v:0}, base_version={val:1745215690649977001, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215690649977003, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215691201737, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:11.207330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:11.217332] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:11.217408] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:11.217611] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:11.217799] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:11.217884] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:17, schedule:53, submit:12, rt:1427, total:1509) [2025-04-21 14:08:11.217965] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:11.218046] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:17, schedule:53, submit:12, device:1427, total:1509) [2025-04-21 14:08:11.218109] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:11.218181] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:654, total:669) [2025-04-21 14:08:11.218269] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:11.218319] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:654, total:669) [2025-04-21 14:08:11.218393] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:11.218421] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:11.219595] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.223036] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFDFF-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:11.223106] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFDFF-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:11.233042] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAC-0-0] [lt=60] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:11.233092] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAC-0-0] [lt=43] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=52) [2025-04-21 14:08:11.254705] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=2693, avg_group_log_size=207) [2025-04-21 14:08:11.254759] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:11.279889] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3532) [2025-04-21 14:08:11.280078] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=76] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3532, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:11.303228] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215691100877000, v:0}, new_max_version={val:1745215691100877000, v:0}, last_min_version={val:1745215690900869000, v:0}, last_max_version={val:1745215690900869000, v:0}, total_time_us=3541, delta_us=202348) [2025-04-21 14:08:11.303280] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215691100877000, v:0}, min_version={val:1745215691100877000, v:0}, max_version={val:1745215691100877000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:11.319664] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.354792] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2571) [2025-04-21 14:08:11.355142] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1745215691355137, bytes: 4099345, bw: 0.013462 MB/s, add_ts: 1007622, add_bytes: 14223 [2025-04-21 14:08:11.356403] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2571) [2025-04-21 14:08:11.357031] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:11.357085] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.359210] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=25] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:08:11.359295] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=75] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:08:11.359316] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=18] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:08:11.359355] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=37] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:11.362115] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=39] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:08:11.363774] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=40] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:08:11.365263] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=41] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:08:11.365303] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:08:11.366607] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:08:11.366722] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=39] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:11.366753] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:11.371058] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=23] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:08:11.372529] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=39] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:08:11.372568] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:08:11.374041] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:11.374154] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:11.374181] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=25] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:11.378529] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=21] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:08:11.380034] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=36] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:08:11.380074] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:08:11.380048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:11.381416] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=29] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:11.381519] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:11.381545] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=23] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:11.381578] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=21] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:11.381642] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=56] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:08:11.381664] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=19] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:11.381695] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:08:11.381727] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=32] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:08:11.381748] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=16] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:08:11.381764] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:11.381789] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:11.381811] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:08:11.381826] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=10] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:08:11.381841] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=14] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:11.381867] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:11.381889] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:08:11.383092] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:11.383132] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=38] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:11.383153] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=20] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:11.383187] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=13] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:08:11.383211] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=22] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:08:11.383230] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=17] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:08:11.383252] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=19] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:08:11.383278] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD8F-0-0] [lt=24] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:08:11.392139] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1314, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:11.392211] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:11.392258] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:11.392298] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1444, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:11.400353] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:11.400427] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] submit log success(service_type_=0, last_id=1745215707945792000, limited_id=1745215707945792000) [2025-04-21 14:08:11.400452] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] submit log with lock success(service_type_=0, last_id=1745215707945792000, limited_id=1745215707945792000) [2025-04-21 14:08:11.400480] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215691400073000, start_id=1745215691400073000, end_id=1745215691400073001) [2025-04-21 14:08:11.401731] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1745215707945792000, latest_scn={val:1745215691400073001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:11.401823] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=90] handle submit callback(service_type_=0, success=true, used_ts=1399, log_ts={val:1745215691400073001, v:0}, limited_id=1745215707945792000) [2025-04-21 14:08:11.401854] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=30] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:11.401875] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:11.402877] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215691402211000, start_id=1745215691402211000, end_id=1745215691402211001) [2025-04-21 14:08:11.407485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:11.414402] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215691414398, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007620, add_bytes: 0 [2025-04-21 14:08:11.417193] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:11.419743] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.420678] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:11.420731] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:11.420747] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:11.420774] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:11.420797] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254895970904, flush_io_finished_ret_:0, flush_io_finished_round_:83, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:11.424475] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:11.435857] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:11.435924] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.460516] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3953, offset=42210}, end_cursor:ObLogCursor{file_id=3, log_id=3954, offset=42516}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7878c050, len:2846, log_data_len:306, seq:3953, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:11.460938] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE31-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:11.461062] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE31-0-0] [lt=62] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215691150252001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215691150252001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:11.467673] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=68] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3954, offset=42516}, end_cursor:ObLogCursor{file_id=3, log_id=3955, offset=42813}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c78790050, len:2540, log_data_len:297, seq:3954, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:11.467963] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE31-0-0] [lt=50] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:11.468046] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE31-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215691150252002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215691150252002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:11.468918] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDAF-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:11.475212] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.475278] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.475565] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.476236] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.501754] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:11.501801] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3532) [2025-04-21 14:08:11.519812] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.556240] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:11.556315] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.556542] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1517, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:11.556692] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:11.556746] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2571) [2025-04-21 14:08:11.568587] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:08:11.580633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:11.586135] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:11.598346] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF4F-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:11.601902] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:11.601958] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:11.604191] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215691603600000, start_id=1745215691603600000, end_id=1745215691603600001) [2025-04-21 14:08:11.604533] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:11.604580] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:11.606300] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF53-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:11.606339] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:11.607559] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=47] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:11.607659] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215688723282000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:11.612580] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4200000, replace_num=100000) [2025-04-21 14:08:11.612630] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:11.619893] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.650911] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1745215691650469000, start_id=1745215691650469000, end_id=1745215691650469001) [2025-04-21 14:08:11.650997] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=63] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:11.651037] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215691651022], gts:1745215691650469000, latest_srr:[mts=1745215691651022]}) [2025-04-21 14:08:11.656781] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1670, avg_log_submit_to_slide_time=1689) [2025-04-21 14:08:11.656905] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2571, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:11.695436] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.695529] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.695580] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.695787] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.695861] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=60] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.695971] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.696039] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.696086] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.696314] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.696379] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.696427] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:11.719983] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.753046] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=85] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:11.757085] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=2076) [2025-04-21 14:08:11.757142] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1592, avg_log_submit_to_slide_time=1605) [2025-04-21 14:08:11.757193] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=2076, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:11.781200] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:11.783924] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:11.797433] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=45] XA scheduler heartbeat task statistics(avg_time=4) [2025-04-21 14:08:11.803475] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFDFF-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:11.803544] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFDFF-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:11.805713] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [619992][T1_CompactionRe][T1][YB420B1D7AB6-00063343B7AEFD88-0-0] [lt=41] InfoPoolResizeTask(cost_ts=18) [2025-04-21 14:08:11.806389] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:08:11.806500] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD97-0-0] [lt=51] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:11.806629] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD97-0-0] [lt=123] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:11.807981] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:11.809215] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:11.809270] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=45] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:11.812743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:11.817245] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:11.817440] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:11.817500] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:08:11.817525] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:11.817552] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:11.817576] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254896367661, flush_io_finished_ret_:0, flush_io_finished_round_:83, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:11.820056] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=85][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.824565] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:11.827762] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:11.829279] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=51] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:11.829368] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=86] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:11.829471] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=60] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:11.829803] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=326] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:11.829874] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=60] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:11.829929] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=51] get rec log scn(service_type_=0, rec_log_ts={val:1745215688645705001, v:0}) [2025-04-21 14:08:11.829959] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=28] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:11.829987] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:11.830022] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:11.830069] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=39] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:11.830106] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:11.830153] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:11.830204] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=49] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:11.830236] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=28] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:11.835686] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=45] clear dtl interm result cost(us)(clear_cost=3033, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:11.857224] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:11.857289] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.873078] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=44][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:11.873239] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=58][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:11.874816] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=33] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215691873273) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215691873273) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:11.879556] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFF9-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:11.880673] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:11.880743] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1466, avg_log_submit_to_slide_time=1491) [2025-04-21 14:08:11.882069] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFF9-0-0] [lt=47][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254897432375, cache_obj->added_lc()=false, cache_obj->get_object_id()=618, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:11.884807] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=46] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:11.911849] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=44] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:11.920140] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:11.922277] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=54] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:11.936105] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:11.936189] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:11.952746] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=42] current monitor number(seq_=-1) [2025-04-21 14:08:11.952992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=32] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000) [2025-04-21 14:08:11.953061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=67] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.953958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.954955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955263] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:11.955358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955368] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:11.955412] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1954, avg_group_log_size=177) [2025-04-21 14:08:11.955430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955455] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1954) [2025-04-21 14:08:11.955498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955494] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:11.955676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=39] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.955973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.956974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957257] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1595, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:11.957295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957333] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:11.957364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957436] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:11.957449] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=17, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:11.957489] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1768, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:11.957497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957521] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:11.957563] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:11.957565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957583] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1670, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:11.957634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.957975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.958975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.959964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.960972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.961937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.962994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846986}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846977}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.963976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.964957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965697] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.965956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.966954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846980}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.967942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.968991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101017}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969800] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.969994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.970980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971266] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=44] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:08:11.971312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.971971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.972961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.973980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974111] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.974970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.975976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.976977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977800] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.977933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.978937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846979}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.979937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.980995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:11.981824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.981955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846988}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.982946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.983948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.984936] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.985946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.986949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.987950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.988951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.989989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990651] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.990998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846985}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991135] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8905) [2025-04-21 14:08:11.991200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846978}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101016}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.991992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846993}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.992993] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.993939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.994946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.995941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.996955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101015}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.997991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998866] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.998934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:11.999994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000245] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFEF2-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.106010627746582031e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=405, Throttle Trigger(MB)=243, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.508995856345900393e+02) [2025-04-21 14:08:12.000315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000618] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:12.000683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000927] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.000989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.001957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846987}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.002944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.003947] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=75] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8905, avg_group_log_size=494) [2025-04-21 14:08:12.003973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.004954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.005959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006573] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.006989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846981}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.007955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008729] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.008999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.009975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.010988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.011969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846996}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846991}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.012897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:12.012980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.013938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.014955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846982}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846984}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.015972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.016970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017387] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.017985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018050] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846989}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018729] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.018996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846992}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.019989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020121] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020211] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.020256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020387] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213885534563000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213875525356000, max_merged_snapshot=1) [2025-04-21 14:08:12.020722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=21] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:08:12.024055] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD88-0-0] [lt=2] SSTableGCTask(cost_ts=71433) [2025-04-21 14:08:12.029754] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:12.056479] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:12.056551] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.057081] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1954) [2025-04-21 14:08:12.079216] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:12.079269] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=49] try gc retain ctx [2025-04-21 14:08:12.079286] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:12.079340] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215691901613000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215681892584001, v:0}, keep_alive_scn_:{val:1745215686897989001, v:0}, update_ts_:1745215692078739}) [2025-04-21 14:08:12.080325] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:12.098538] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215692000454000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215692098456}, version_delta=98079) [2025-04-21 14:08:12.100312] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215691901613000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198686, in_cluster_service=true, cluster_version={val:1745215691701790000, v:0}, min_cluster_version={val:1745215691701790000, v:0}, max_cluster_version={val:1745215691701790000, v:0}, get_cluster_version_err=0, cluster_version_delta=398509, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=734, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=29630436, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:12.102285] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=74] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:12.102340] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:12.103832] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1442, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:12.103885] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:12.103942] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:12.103980] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1570, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:12.104010] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:12.120281] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.151497] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=440, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:12.151541] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=42] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215692151466], gts:1745215692150779000, latest_srr:[mts=1745215692151466]}) [2025-04-21 14:08:12.168647] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCD-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:12.168703] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCD-0-0] [lt=52] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:12.182282] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:12.201430] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8511) [2025-04-21 14:08:12.201518] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8511) [2025-04-21 14:08:12.201580] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=69, avg_log_gen_to_submit_time=85, avg_log_submit_to_flush_time=1385, avg_log_submit_to_slide_time=1404) [2025-04-21 14:08:12.201616] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:12.201656] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8511, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:12.201768] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:12.213040] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:12.219467] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:12.219532] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:12.219714] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:12.219910] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:12.220000] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:29, submit:9, rt:1182, total:1238) [2025-04-21 14:08:12.220077] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:12.220140] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:17, schedule:29, submit:9, device:1182, total:1238) [2025-04-21 14:08:12.220202] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:12.220273] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:718, total:736) [2025-04-21 14:08:12.220350] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:12.220387] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:718, total:736) [2025-04-21 14:08:12.220368] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.220447] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:12.220473] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:12.224475] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE01-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:12.224536] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE01-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:12.248138] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=67] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:12.255492] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:12.255560] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:12.280859] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:08:12.281068] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:12.303912] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215692101287000, v:0}, new_max_version={val:1745215692101287000, v:0}, last_min_version={val:1745215691901613000, v:0}, last_max_version={val:1745215691901613000, v:0}, total_time_us=3416, delta_us=202621) [2025-04-21 14:08:12.303965] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215692101287000, v:0}, min_version={val:1745215692101287000, v:0}, max_version={val:1745215692101287000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:12.320436] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.355585] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:12.357385] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:172) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:08:12.357437] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=49] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:12.357464] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.357573] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:12.362748] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215692362743, bytes: 4112117, bw: 0.012088 MB/s, add_ts: 1007606, add_bytes: 12772 [2025-04-21 14:08:12.382763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:12.393102] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1328, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:12.393537] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=423] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:12.393607] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:12.393650] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1536, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:12.399312] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:08:12.399362] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:12.400395] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:12.413181] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:12.417284] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:12.420522] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.420926] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:12.420979] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:12.420997] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:12.421040] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:12.421067] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254896971156, flush_io_finished_ret_:0, flush_io_finished_round_:84, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:12.422038] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215692422033, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2025-04-21 14:08:12.423941] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=92] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:12.424660] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:12.436325] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:12.436385] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.457479] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=33, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:12.457536] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=56] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=1846, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:12.457553] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:12.457567] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-664, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:12.457580] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=1214, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:12.463239] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:08:12.473926] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=64] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3955, offset=42813}, end_cursor:ObLogCursor{file_id=3, log_id=3956, offset=43119}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c78794050, len:2243, log_data_len:306, seq:3955, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:12.474291] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE32-0-0] [lt=55] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:12.474368] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE32-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215692150779002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215692150779002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:12.475322] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.475386] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.475426] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.475576] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.477785] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE32-0-0] [lt=26] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=1, MAX_GAP=900000000000, new_sync_scn={val:1745215691150252003, v:0}, new_replayable_scn={val:1745215691150252003, v:0}, new_readable_scn={val:1745215691150252002, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215690148905003, replayable_scn:1745215690148905003, readable_scn:1745215690148905003, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:08:12.481027] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=70] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3956, offset=43119}, end_cursor:ObLogCursor{file_id=3, log_id=3957, offset=43416}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c78798050, len:1937, log_data_len:297, seq:3956, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:12.481297] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE32-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:12.481357] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE32-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215692150779002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215692150779002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:12.502484] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215692501569000, start_id=1745215692501569000, end_id=1745215692501569001) [2025-04-21 14:08:12.502613] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3525, avg_group_log_size=352) [2025-04-21 14:08:12.502653] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3525) [2025-04-21 14:08:12.514874] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=85] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:12.520570] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.522949] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFFB-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:12.525394] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFFB-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254898075702, cache_obj->added_lc()=false, cache_obj->get_object_id()=619, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:12.526901] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFFF-0-0] [lt=40][errcode=-4201] hashtable not init [2025-04-21 14:08:12.526950] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AEFFFF-0-0] [lt=48] get cursor info failed(cursor_id=29, get_sessid()=3221487630) [2025-04-21 14:08:12.527125] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215692526206000, start_id=1745215692526206000, end_id=1745215692526206001) [2025-04-21 14:08:12.556740] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:12.556813] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.557380] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1642, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:12.557560] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:12.557640] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:12.563520] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:08:12.563586] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=55] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:12.568672] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:12.572432] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:12.572490] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:12.572509] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:12.572531] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:12.572554] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254897122499, flush_io_finished_ret_:0, flush_io_finished_round_:84, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:12.583388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:12.586324] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:12.598640] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=39] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:12.598714] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=59] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=17) [2025-04-21 14:08:12.600541] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:12.600585] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:12.602276] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:12.602307] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:12.604153] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:25774012}], scn_array=[cnt:1, {val:1745215692482366001, v:0}], curr_size=122, accum_size=3895, time_cost=12490) [2025-04-21 14:08:12.613324] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:12.620608] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.652035] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:12.656842] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=20] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:12.656907] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=63] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:08:12.656928] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=20] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:12.656945] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=14] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:12.657663] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1934, avg_log_submit_to_slide_time=1947) [2025-04-21 14:08:12.657735] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:12.664226] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25775312}, readable_log_tail:{lsn:25775312}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41329456, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:12.664349] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=122] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:08:12.664391] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:12.666156] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:08:12.666208] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=43] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:12.666257] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:12.674272] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] [COMPACTION DAG STATUS] (start_time=1745215682670839, end_time=1745215692674268, dag_status={}) [2025-04-21 14:08:12.674317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=42] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674337] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674376] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674395] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674413] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674450] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:12.674486] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674511] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674548] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674566] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674604] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674623] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674642] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674661] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674678] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674710] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674741] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674812] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674922] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674942] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674961] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.674997] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675036] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675090] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675126] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675144] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675214] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675251] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675269] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675287] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675395] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675413] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675430] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675449] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675550] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675610] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675629] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675647] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675664] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675699] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675716] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675752] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:12.675860] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:12.675878] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:12.675898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:12.675914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:12.675930] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:12.675945] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:12.675960] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:12.675975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:12.675990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:12.676005] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:12.676022] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:12.686851] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=57] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585100161024, fast_delete_log_mode=false) [2025-04-21 14:08:12.691923] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=24] Garbage Collector is running(seq_=9, gc_interval=10000000) [2025-04-21 14:08:12.692024] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=58] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:12.692060] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=27] gc_check_member_list_ cost time(ret=0, time_us=77) [2025-04-21 14:08:12.692090] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:12.693550] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:12.693597] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=39] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:12.693617] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] execute_gc cost time(ret=0, time_us=23) [2025-04-21 14:08:12.693640] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] ObSafeDestroyHandler start process [2025-04-21 14:08:12.693661] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:08:12.693695] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:08:12.695145] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695373] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=69] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695431] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695466] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695577] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695664] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695721] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695728] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695884] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.695944] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.696493] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:12.708969] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDC9-0-0] [lt=37] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:12.720741] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:12.720772] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:12.720796] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.750776] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15374, max_lsn:25775312, max_scn:{val:1745215692603506000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:25775312}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:25774723}, last_submit_end_lsn:{lsn:25775312}, last_submit_log_id:15374, last_submit_log_pid:3, max_flushed_lsn:{lsn:25774723}, max_flushed_end_lsn:{lsn:25775312}, max_flushed_log_pid:3, committed_end_lsn:{lsn:25775312}, last_slide_log_id:15374, last_slide_scn:{val:1745215692603506000, v:0}, last_slide_lsn:{lsn:25774723}, last_slide_end_lsn:{lsn:25775312}, last_slide_log_pid:3, last_slide_log_accum_checksum:1904782641, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15375, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:25775312}, readable_log_tail:{lsn:25775312}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41329456, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:08:12.751053] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=269] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215692606574, last_flushed_end_lsn:{lsn:25775312}}]) [2025-04-21 14:08:12.751079] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15375, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215692606574, last_flushed_end_lsn:{lsn:25775312}}]) [2025-04-21 14:08:12.757837] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:12.757904] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1824, avg_log_submit_to_slide_time=1845) [2025-04-21 14:08:12.757961] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:12.771889] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDCB-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:12.772041] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDCD-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:12.774092] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=67] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:12.783899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:12.784051] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:12.790096] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=56] BlockGCTimerTask success(ret=0, cost_time_us=33, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:12.805323] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE00-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:12.805392] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE00-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:12.813464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:12.817324] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:12.817714] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:12.817771] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:12.817790] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:12.817817] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:12.817842] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254897367937, flush_io_finished_ret_:0, flush_io_finished_round_:84, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:12.820724] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.824749] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:12.850844] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=37] LogLoopThread round_cost_time(us)(round_cost_time=365) [2025-04-21 14:08:12.857601] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:12.857692] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=81] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.881485] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4084) [2025-04-21 14:08:12.881578] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1586, avg_log_submit_to_slide_time=1608) [2025-04-21 14:08:12.885821] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0001-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:12.888285] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0001-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254898438593, cache_obj->added_lc()=false, cache_obj->get_object_id()=620, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:12.906484] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDBA-0-0] [lt=41] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:12.911893] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=54] start to print blacklist info [2025-04-21 14:08:12.912063] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] ls blacklist refresh finish(cost_time=8594) [2025-04-21 14:08:12.920792] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:12.936519] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:12.936584] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:12.952909] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=56] current monitor number(seq_=-1) [2025-04-21 14:08:12.956233] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:12.956317] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:12.956352] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:12.956384] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:12.956416] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:12.957960] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=83] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=88, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:12.958023] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:12.958060] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1810, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:12.958046] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1926, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:12.958087] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:12.958106] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:12.958126] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2054, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:12.958145] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:12.984450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:12.991995] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:08:12.998006] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDCE-0-0] [lt=20][errcode=-4006] not init(ret=-4006) [2025-04-21 14:08:12.998078] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:478) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDCE-0-0] [lt=62] finish scan map holding items(scan_cnt=0) [2025-04-21 14:08:12.998148] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDCF-0-0] [lt=19] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:12.998260] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:12.998301] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=41] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:12.998302] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA8-0-0] [lt=41] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:12.998359] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA8-0-0] [lt=50] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:13.000851] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFEF7-0-0] [lt=40] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082011222839355469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.586177680023797620e+02) [2025-04-21 14:08:13.001206] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:13.004704] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] get number(ret=0, service_type_=0, range=1, base_id=1745215693003728000, start_id=1745215693003728000, end_id=1745215693003728001) [2025-04-21 14:08:13.004799] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8382, avg_group_log_size=493) [2025-04-21 14:08:13.013611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:13.020861] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.029899] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=49] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:13.045724] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:13.045858] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=86] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:13.045893] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=128, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:13.045973] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:13.046045] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:13.046069] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=8, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:13.056952] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:13.057045] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=83] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.058132] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:13.093469] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=71] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:13.104235] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:13.104332] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:13.106131] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1524, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:13.106194] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:13.106272] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:13.106324] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1666, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:13.106359] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:13.120939] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.170549] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCE-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:13.170610] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCE-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:13.185042] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:13.200259] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=9200000, clean_num=200000) [2025-04-21 14:08:13.202766] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8382) [2025-04-21 14:08:13.202883] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8382) [2025-04-21 14:08:13.202955] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=228, avg_log_gen_to_submit_time=247, avg_log_submit_to_flush_time=2112, avg_log_submit_to_slide_time=2133) [2025-04-21 14:08:13.202996] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:13.203050] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8382, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:13.213785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:13.221040] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.222189] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:13.222258] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:13.222449] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:13.222646] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:13.222764] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8169, [delay/us]:prepare:18, schedule:28, submit:10, rt:1209, total:1266) [2025-04-21 14:08:13.222845] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:13.222910] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8169, [delay/us]: prepare:18, schedule:28, submit:10, device:1209, total:1266) [2025-04-21 14:08:13.222971] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:13.223044] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4084, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:609, total:624) [2025-04-21 14:08:13.223123] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:13.223161] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4084, [delay/us]: prepare:0, schedule:0, submit:600000000, device:609, total:624) [2025-04-21 14:08:13.223221] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:13.223248] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:13.227003] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE02-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:13.227163] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE02-0-0] [lt=153] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:13.233670] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAD-0-0] [lt=48] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:13.233725] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAD-0-0] [lt=46] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=58) [2025-04-21 14:08:13.256469] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:13.256549] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:13.258894] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=52] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:13.260114] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=55] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:13.260213] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215691147050000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:13.281846] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4093) [2025-04-21 14:08:13.282038] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4093, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:13.305303] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215693103498000, v:0}, new_max_version={val:1745215693103498000, v:0}, last_min_version={val:1745215692902107000, v:0}, last_max_version={val:1745215692902107000, v:0}, total_time_us=3782, delta_us=201801) [2025-04-21 14:08:13.305371] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=64] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215693103498000, v:0}, min_version={val:1745215693103498000, v:0}, max_version={val:1745215693103498000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:13.321094] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.356596] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:13.357802] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:13.357864] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.358353] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:13.370386] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215693370376, bytes: 4126340, bw: 0.013461 MB/s, add_ts: 1007633, add_bytes: 14223 [2025-04-21 14:08:13.393832] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1956, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:13.393939] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:13.394013] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:13.394089] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=76] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2310, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:13.400925] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:13.402244] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:13.404511] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:13.414009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=93] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:13.417416] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:08:13.421167] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.421289] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:13.421407] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=96] temporary file module use no blocks [2025-04-21 14:08:13.421456] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:13.421507] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:13.421557] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254897971428, flush_io_finished_ret_:0, flush_io_finished_round_:85, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:13.424908] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:13.429651] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1745215693429642, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2025-04-21 14:08:13.436821] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:13.436908] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.474820] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB0-0-0] [lt=41] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:13.475183] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.475153] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.475246] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.475286] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.487250] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3957, offset=43416}, end_cursor:ObLogCursor{file_id=3, log_id=3958, offset=43722}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7879c050, len:1640, log_data_len:306, seq:3957, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:13.487615] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:13.487632] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE33-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:13.487716] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE33-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215693151967002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215693151967002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:13.488842] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=53] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:13.488945] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215685534563000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:13.494679] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=62] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3958, offset=43722}, end_cursor:ObLogCursor{file_id=3, log_id=3959, offset=44019}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787a0050, len:1334, log_data_len:297, seq:3958, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:13.495029] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE33-0-0] [lt=52] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:13.495105] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE33-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215693151967002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215693151967002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:13.503697] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4094, avg_group_log_size=372) [2025-04-21 14:08:13.503768] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4094) [2025-04-21 14:08:13.507724] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=55][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:13.521251] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=91][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.523591] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0003-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:13.526320] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0003-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254899076626, cache_obj->added_lc()=false, cache_obj->get_object_id()=621, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:13.557164] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:13.557235] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.558770] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:13.558810] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1662, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:13.558951] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:13.558964] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=71, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:13.558994] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=29] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1825, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:13.559017] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=23] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:13.559038] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=19] [APPLY STAT CB EXECUTE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=-604, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:13.559058] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1292, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:13.560467] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=21] ====== traversal_flush timer task ====== [2025-04-21 14:08:13.560618] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD96-0-0] [lt=45] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215693151967003, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215700473222000, latest_log_ts:{val:1745215684141041001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:13.560794] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD96-0-0] [lt=136] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:13.560873] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD96-0-0] [lt=75] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:13.568763] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=46] gc stale ls task succ [2025-04-21 14:08:13.572684] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:13.586525] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:13.600740] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:13.600805] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:13.601464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:13.602682] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:13.602734] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:13.614191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=87] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:13.621283] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.622362] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:08:13.623431] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:13.623510] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=77] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:13.623584] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215700473222000, latest_log_ts:{val:1745215684141041001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:13.623689] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:13.623722] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:13.623749] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215684141041001, v:0}) [2025-04-21 14:08:13.623770] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:13.623795] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:13.623827] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:13.623849] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:13.623885] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:13.623920] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:13.624909] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:13.624950] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:13.624998] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:13.625097] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:13.625114] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:13.625137] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:13.625160] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:13.625181] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:13.625203] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:13.625229] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:13.625246] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:13.641040] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=59] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:13.653066] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=51] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:13.653356] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215693653337], gts:1745215693652605000, latest_srr:[mts=1745215693653337]}) [2025-04-21 14:08:13.660232] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=34, avg_log_submit_to_flush_time=2114, avg_log_submit_to_slide_time=2130) [2025-04-21 14:08:13.660324] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:13.695292] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695300] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=54] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695370] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695415] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695471] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695548] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695586] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.695982] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.696057] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.696225] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.696582] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:13.721358] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.756812] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=64] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:13.756877] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=62] try gc retain ctx [2025-04-21 14:08:13.756893] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:13.756952] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215693652605000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215683640490001, v:0}, keep_alive_scn_:{val:1745215688646785001, v:0}, update_ts_:1745215693756746}) [2025-04-21 14:08:13.757992] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215700473222000, latest_log_ts:{val:1745215684141041001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:13.758213] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=122] finish update min start scn(max_decided_scn={val:1745215693652605000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215683640490001, v:0}, keep_alive_scn_:{val:1745215688646785001, v:0}, update_ts_:1745215693757811}) [2025-04-21 14:08:13.759269] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:13.760761] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:13.760822] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1908, avg_log_submit_to_slide_time=1928) [2025-04-21 14:08:13.760880] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:13.761547] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD98-0-0] [lt=54] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:13.762096] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=121] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:13.784167] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:13.801980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:13.807520] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE01-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:13.807613] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE01-0-0] [lt=88] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:13.809371] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:08:13.809421] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:13.809659] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:13.817396] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:13.819238] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4300000, replace_num=100000) [2025-04-21 14:08:13.819299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:13.821426] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.824948] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:13.857988] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:13.858067] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.873152] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:13.875040] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] get number(ret=0, service_type_=0, range=1, base_id=1745215693874865000, start_id=1745215693874865000, end_id=1745215693874865001) [2025-04-21 14:08:13.882241] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:13.882306] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1832, avg_log_submit_to_slide_time=1857) [2025-04-21 14:08:13.892983] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0005-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:13.896518] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0005-0-0] [lt=82][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254899446820, cache_obj->added_lc()=false, cache_obj->get_object_id()=622, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:13.903849] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215693652605000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=251231, in_cluster_service=true, cluster_version={val:1745215693151967004, v:0}, min_cluster_version={val:1745215693151967004, v:0}, max_cluster_version={val:1745215693151967004, v:0}, get_cluster_version_err=0, cluster_version_delta=751869, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=726, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=24779572, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:13.921448] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:13.937082] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:13.937158] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:13.953051] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=55] current monitor number(seq_=-1) [2025-04-21 14:08:13.957034] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=88] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:13.957146] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=69] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:13.957176] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:13.957212] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:13.957242] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:13.958696] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1896, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:13.958776] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=71] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:13.958766] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=87] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:13.958842] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:13.958889] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1908, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:13.958943] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:13.958964] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2067, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:13.958989] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:13.992926] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8808) [2025-04-21 14:08:13.994882] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=33] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=54, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:13.994949] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=66] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1854, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:13.994967] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:13.994990] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-496, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:13.995004] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1412, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:14.002107] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] get_max_applied_scn(scn={val:1745215693903689000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65617521}, palf_committed_end_scn_:{val:1745215693903689000, v:0}, last_check_scn_:{val:1745215693903689000, v:0}, max_applied_cb_scn_:{val:1745215693903689000, v:0}}) [2025-04-21 14:08:14.002192] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=72] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65617521}, readable_log_tail:{lsn:65617521}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1487247, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:14.002548] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:14.002577] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFEFC-0-0] [lt=63] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082011222839355469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.586177680023797620e+02) [2025-04-21 14:08:14.003206] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=121] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:14.005303] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get_max_applied_scn(scn={val:1745215693874865000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25786130}, palf_committed_end_scn_:{val:1745215694003127000, v:0}, last_check_scn_:{val:1745215694003127000, v:0}, max_applied_cb_scn_:{val:1745215693874865000, v:0}}) [2025-04-21 14:08:14.005374] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=62] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25786130}, readable_log_tail:{lsn:25786130}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41318638, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:14.005968] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8809, avg_group_log_size=518) [2025-04-21 14:08:14.019422] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=26] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:14.021520] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.030053] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=54] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:14.035607] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:14.035679] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=65] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:14.035725] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=43] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:14.035758] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=29] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:14.039493] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:14.040199] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=700] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:14.057378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:14.057453] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.059005] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:14.090937] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=137] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:14.121590] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.153625] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=41] ts response task statistics(alloc_count=1806, free_count=902) [2025-04-21 14:08:14.153953] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=51] submit log success(service_type_=0, last_id=1745215710473222000, limited_id=1745215710473222000) [2025-04-21 14:08:14.153986] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=32] submit log with lock success(service_type_=0, last_id=1745215710473222000, limited_id=1745215710473222000) [2025-04-21 14:08:14.154025] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=13] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=378, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:14.155653] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=22] update id meta(ret=0, service_type=0, limited_id=1745215710473222000, latest_scn={val:1745215694153093001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215691150252003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:14.155743] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=89] handle submit callback(service_type_=0, success=true, used_ts=1791, log_ts={val:1745215694153093001, v:0}, limited_id=1745215710473222000) [2025-04-21 14:08:14.155761] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=17] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:14.155784] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF52-0-0] [lt=21] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:14.172365] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCF-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:14.172415] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDCF-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:14.203095] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:14.203614] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8809) [2025-04-21 14:08:14.203704] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8809) [2025-04-21 14:08:14.203762] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1787, avg_log_submit_to_slide_time=1806) [2025-04-21 14:08:14.203796] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:14.203834] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8809, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:14.207201] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=42] get_max_applied_scn(scn={val:1745215693652605004, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17295016}, palf_committed_end_scn_:{val:1745215694153093001, v:0}, last_check_scn_:{val:1745215694153093001, v:0}, max_applied_cb_scn_:{val:1745215693652605004, v:0}}) [2025-04-21 14:08:14.207259] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=49] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17295016}, readable_log_tail:{lsn:17295016}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49809752, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:14.209496] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=59] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:14.219573] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:14.221658] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.224444] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:14.224514] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:14.224706] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:14.224895] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:14.224983] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:17, schedule:34, submit:9, rt:1342, total:1403) [2025-04-21 14:08:14.225081] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:14.225146] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:17, schedule:34, submit:9, device:1342, total:1403) [2025-04-21 14:08:14.225206] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:14.225289] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1090, total:1107) [2025-04-21 14:08:14.225368] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:14.225405] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1090, total:1107) [2025-04-21 14:08:14.225466] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:14.225492] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:14.228732] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE03-0-0] [lt=27] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:14.228794] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE03-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:14.257233] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:08:14.257285] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:14.265753] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=106] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:14.269247] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=60] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:14.280861] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=116] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:14.280914] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:14.282309] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1694, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:14.282391] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:14.282434] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:14.282478] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1853, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:14.282507] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:14.304200] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=96] get_max_applied_scn(scn={val:1745215694153093000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8707629}, palf_committed_end_scn_:{val:1745215694153093001, v:0}, last_check_scn_:{val:1745215694153093001, v:0}, max_applied_cb_scn_:{val:1745215694153093000, v:0}}) [2025-04-21 14:08:14.304253] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8707629}, readable_log_tail:{lsn:8707629}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58397139, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:14.305858] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4120) [2025-04-21 14:08:14.306073] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4120, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:14.321737] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.357313] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:08:14.358179] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:14.358233] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.359173] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:08:14.377980] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=105] PNIO [ratelimit] time: 1745215694377975, bytes: 4139112, bw: 0.012088 MB/s, add_ts: 1007599, add_bytes: 12772 [2025-04-21 14:08:14.389646] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=57] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:14.394342] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1702, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:14.394405] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:14.394454] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:14.394493] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1832, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:14.396039] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620177][T1001_Compactio][T1001][YB420B1D7AB6-00063343B7CEFD88-0-0] [lt=51] InfoPoolResizeTask(cost_ts=11) [2025-04-21 14:08:14.396243] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=22] ====== traversal_flush timer task ====== [2025-04-21 14:08:14.396405] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD97-0-0] [lt=62] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215694205500000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:14.396563] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD97-0-0] [lt=150] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:14.398076] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:14.398126] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=37] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:14.398154] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=18) [2025-04-21 14:08:14.399497] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:14.399535] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=29] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:14.402422] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:14.403576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:14.403965] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215694201230000, v:0}, new_max_version={val:1745215694201230000, v:0}, last_min_version={val:1745215694003127000, v:0}, last_max_version={val:1745215694003127000, v:0}, total_time_us=3479, delta_us=202731) [2025-04-21 14:08:14.404008] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215694201230000, v:0}, min_version={val:1745215694201230000, v:0}, max_version={val:1745215694201230000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:14.417451] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=123] gc stale ls task succ [2025-04-21 14:08:14.419731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:14.421749] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=92] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:14.421799] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:14.421817] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:14.421804] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.421844] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:14.421868] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254898971966, flush_io_finished_ret_:0, flush_io_finished_round_:86, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:14.423792] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:14.424873] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=159] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:14.424931] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=57] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:14.424998] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:14.425075] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:14.425115] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=112] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:14.425161] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:14.425188] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215691400073001, v:0}) [2025-04-21 14:08:14.425209] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:14.425229] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:14.425251] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:14.425282] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:14.425305] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:14.425337] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:14.425371] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:14.425393] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:14.432683] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=82] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:14.437265] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=90] PNIO [ratelimit] time: 1745215694437260, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:08:14.437326] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:14.437381] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.444713] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] success to update min reserved snapshot(reserved_snapshot=1745213888723282000, duration=1800, snapshot_gc_ts=1745215688723282000) [2025-04-21 14:08:14.446711] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=45] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213888723282000) [2025-04-21 14:08:14.446759] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] update reserved snapshot finished(cost_ts=2052, reserved_snapshot=1745213888723282000) [2025-04-21 14:08:14.449157] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:14.449318] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=56][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:14.451009] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215694449350) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215694449350) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:14.462154] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=41] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:14.464896] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=48] ====== tenant freeze timer task ====== [2025-04-21 14:08:14.474904] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.475288] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=70] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.475368] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.475425] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.501515] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=75] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3959, offset=44019}, end_cursor:ObLogCursor{file_id=3, log_id=3960, offset=44325}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787a4050, len:1037, log_data_len:306, seq:3959, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:14.502026] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE34-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:14.502100] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE34-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215694153093003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215694153093003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:14.505799] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE34-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1745215694504840000, start_id=1745215694504840000, end_id=1745215694504840001) [2025-04-21 14:08:14.507159] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=111] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:14.507218] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:14.508953] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=92] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3960, offset=44325}, end_cursor:ObLogCursor{file_id=3, log_id=3961, offset=44622}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787a8050, len:731, log_data_len:297, seq:3960, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:14.509318] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE34-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:14.509371] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE34-0-0] [lt=34] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215694153093003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215694153093003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:14.521875] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.557695] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:14.557765] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.559729] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1217) [2025-04-21 14:08:14.559759] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1772, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:14.559861] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:14.563741] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=32] ====== check clog disk timer task ====== [2025-04-21 14:08:14.563791] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:14.568851] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:08:14.572874] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=71] temporary file module use no blocks [2025-04-21 14:08:14.572937] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=58] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:14.572976] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:14.573045] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=68] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254899123079, flush_io_finished_ret_:0, flush_io_finished_round_:86, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:14.577591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000) [2025-04-21 14:08:14.577640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=49] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.577714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.577807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.577885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.577972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.578947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.579941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.580944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.581937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.582961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.583964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.584968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.585938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586718] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:14.586784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.586936] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587799] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.587934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.588946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.589962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590229] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.590968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.591974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.592988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593184] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=107] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:14.593207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593231] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] try gc retain ctx [2025-04-21 14:08:14.593254] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=21] try to retry start_working [2025-04-21 14:08:14.593275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593318] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215694405430001, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215684397045002, v:0}, keep_alive_scn_:{val:1745215689441834001, v:0}, update_ts_:1745215694592269}) [2025-04-21 14:08:14.593347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.593947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594315] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=35] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:14.594420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.594978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.595960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.596995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.597947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.598961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.599969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600831] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:14.600880] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:14.600902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.600971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.601937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602564] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:14.602614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602597] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:14.602682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.602972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.603944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:14.604147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604534] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:14.604569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.604969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605862] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.605995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.606968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.607941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.608942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.609957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610764] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.610962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.611971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612775] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=22] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:14.612850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.612985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613281] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.613941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614114] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:14.614141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614231] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215688723282000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:14.614295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.614981] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.615979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.616982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.617933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.618959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.619875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:14.619952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.620942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.621952] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.622036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.622990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.623995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624524] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.624986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.625957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626289] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.626970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.627965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628764] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.628963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.629967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.630965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.631961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.632961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.633975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.634983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635050] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.635986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636647] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.636984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637862] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.637995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.638938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.639934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640729] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.640989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.641935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213888723282000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213888723282000, max_merged_snapshot=1) [2025-04-21 14:08:14.642359] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD88-0-0] [lt=22] SSTableGCTask(cost_ts=65065) [2025-04-21 14:08:14.651503] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:14.651572] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=50] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=16) [2025-04-21 14:08:14.652283] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:14.652343] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=47] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:14.652377] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=31] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:14.652398] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=16) [2025-04-21 14:08:14.654286] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:14.654347] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=403, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:14.654370] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215694654330], gts:1745215694654302000, latest_srr:[mts=1745215694654330]}) [2025-04-21 14:08:14.667560] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2025-04-21 14:08:14.667647] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=74] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:14.667698] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:14.687360] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=18] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:14.687438] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=58] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=18) [2025-04-21 14:08:14.690734] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:14.690802] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=53] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:14.690826] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=20] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=18) [2025-04-21 14:08:14.695102] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695120] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=55] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695253] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=48] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695310] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695455] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=59] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695516] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.695554] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.696304] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.696389] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.696446] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.696489] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:14.700737] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215694511261000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=189464, in_cluster_service=true, cluster_version={val:1745215694405430000, v:0}, min_cluster_version={val:1745215694405430000, v:0}, max_cluster_version={val:1745215694405430000, v:0}, get_cluster_version_err=0, cluster_version_delta=295295, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=732, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=29521318, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:14.722026] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.759560] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=1880, avg_log_submit_to_slide_time=1902) [2025-04-21 14:08:14.759669] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1339, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:14.784294] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=53] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:14.804564] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:14.808926] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE02-0-0] [lt=26] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:14.808989] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE02-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:14.817482] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:14.818059] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=55] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:14.818109] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:08:14.818132] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:14.818166] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=32] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:14.818191] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254899368299, flush_io_finished_ret_:0, flush_io_finished_round_:86, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:14.820008] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:14.822091] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.825129] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=69] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:14.858328] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:14.858380] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.859598] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:08:14.859679] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1788, avg_log_submit_to_slide_time=1812) [2025-04-21 14:08:14.859729] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:14.867447] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:14.867492] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:14.867512] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:14.867528] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:14.870871] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:14.871563] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=689] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:14.882942] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:14.882997] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1554, avg_log_submit_to_slide_time=1574) [2025-04-21 14:08:14.900643] WDIAG begin (ob_hashtable.h:954) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD87-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:14.903214] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD87-0-0] [lt=50][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254900453455, cache_obj->added_lc()=false, cache_obj->get_object_id()=623, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:14.922156] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:14.922438] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=66] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:14.928026] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:14.929512] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215694928690000, start_id=1745215694928690000, end_id=1745215694928690001) [2025-04-21 14:08:14.937502] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:14.937556] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:14.948097] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:14.957762] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:14.957849] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:14.957881] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:14.957923] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:14.957952] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:14.959576] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:14.959608] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1757, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:14.959640] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=85, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:14.959667] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:14.959731] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1853, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:14.959796] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:14.959823] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1954, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:14.959842] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:14.993544] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8487) [2025-04-21 14:08:14.999218] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=26] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:14.999260] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=41] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:14.999283] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA9-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:14.999336] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDA9-0-0] [lt=48] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:15.002567] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF01-0-0] [lt=66] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082011222839355469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.586177680023797620e+02) [2025-04-21 14:08:15.005150] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:15.006287] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=123] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:15.006339] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8487, avg_group_log_size=471) [2025-04-21 14:08:15.020147] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:15.022226] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.022960] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=16) [2025-04-21 14:08:15.030204] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=51] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:15.057976] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:15.058034] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.059751] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:15.101689] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=104] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:15.122294] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.154886] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215695154850], gts:1745215695154310000, latest_srr:[mts=1745215695154850]}) [2025-04-21 14:08:15.161304] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=66][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:15.174179] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD0-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:15.174227] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD0-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:15.203992] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8487) [2025-04-21 14:08:15.204068] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8487) [2025-04-21 14:08:15.204123] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1441, avg_log_submit_to_slide_time=1458) [2025-04-21 14:08:15.204159] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:15.204201] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=109] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8487, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:15.205650] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:15.214762] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=9400000, clean_num=200000) [2025-04-21 14:08:15.220282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:15.222362] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.226544] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:15.226607] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:15.226800] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:15.227002] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:15.227086] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:20, schedule:73, submit:9, rt:1205, total:1308) [2025-04-21 14:08:15.227163] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:15.227229] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:20, schedule:73, submit:9, device:1205, total:1308) [2025-04-21 14:08:15.227290] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:15.227361] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:602, total:615) [2025-04-21 14:08:15.227443] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:15.227480] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:602, total:615) [2025-04-21 14:08:15.227540] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:15.227566] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:15.230556] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE04-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:15.230618] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE04-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.234284] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAE-0-0] [lt=43] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:15.234356] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAE-0-0] [lt=62] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=75) [2025-04-21 14:08:15.253540] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB2-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.256392] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=49] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:15.256528] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=133] check all tenants(ret=0) [2025-04-21 14:08:15.257852] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB5-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.257982] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:15.258037] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:15.259215] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB6-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.260535] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB7-0-0] [lt=38] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.261858] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB8-0-0] [lt=38] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.263184] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDB9-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.264479] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDBA-0-0] [lt=38] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.265789] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDBB-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.281583] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:15.281663] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:15.283276] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65626404, this={dio_aligned_buf:{buf_write_offset:414, buf_padding_size:3682, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2619, truncate_used_ts:1057}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65626112, buf_len=122, total_write_size=38981, total_write_size_after_dio=479232, ob_pwrite_used_ts=210564, count=107, each_pwrite_cost=1967) [2025-04-21 14:08:15.283380] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=98] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1449, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:15.283416] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:15.283474] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:15.283509] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1578, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:15.283540] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:15.289232] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] success to update min reserved snapshot(reserved_snapshot=1745213885534563000, duration=1800, snapshot_gc_ts=1745215685534563000) [2025-04-21 14:08:15.290825] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] update reserved snapshot finished(cost_ts=1598, reserved_snapshot=1745213885534563000) [2025-04-21 14:08:15.307087] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619978][T1_TenantWeakRe][T1][YB420B1D7AB6-00063343B1EEFF14-0-0] [lt=33] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=update __all_weak_read_service set min_version=?, max_version=? where tenant_id = ? and level_id = ? and level_value = ? and min_version = ? and max_version = ?) [2025-04-21 14:08:15.309082] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4191) [2025-04-21 14:08:15.309237] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4191, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:15.322434] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.358069] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:15.358476] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:15.358523] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.359824] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:15.385597] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215695385592, bytes: 4153335, bw: 0.013462 MB/s, add_ts: 1007617, add_bytes: 14223 [2025-04-21 14:08:15.395120] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1405, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:15.395177] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:15.395229] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:15.395271] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1513, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:15.402800] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1745215695402347000, start_id=1745215695402347000, end_id=1745215695402347001) [2025-04-21 14:08:15.402913] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:15.404288] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215695202456000, v:0}, new_max_version={val:1745215695202456000, v:0}, last_min_version={val:1745215695002558000, v:0}, last_max_version={val:1745215695002558000, v:0}, total_time_us=3016, delta_us=201829) [2025-04-21 14:08:15.404334] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215695202456000, v:0}, min_version={val:1745215695202456000, v:0}, max_version={val:1745215695202456000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:15.415245] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:15.417538] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:15.420415] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:15.422008] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:15.422058] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:08:15.422074] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:15.422096] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:15.422114] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254899972227, flush_io_finished_ret_:0, flush_io_finished_round_:87, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:15.422499] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.425236] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:15.437661] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:15.437714] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.444865] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215695444860, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2025-04-21 14:08:15.474813] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.474883] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.474929] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.475105] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.480190] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB1-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:15.501367] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get wrs ts(ls_id={id:1}, delta=98425, log_service_ts=1745215695402347, min_tx_service_ts=4611686018427387, timestamp={val:1745215695402347000, v:0}) [2025-04-21 14:08:15.501411] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=53, Other_Error_Cnt=0, Submit_Succ_Cnt=47, last_scn="{val:1745215694511261001, v:0}", last_lsn={lsn:25791371}, last_gts={val:1745215695405570000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:08:15.502880] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=69] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:15.507494] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4191, avg_group_log_size=349) [2025-04-21 14:08:15.507539] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4191) [2025-04-21 14:08:15.516646] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=65] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3961, offset=44622}, end_cursor:ObLogCursor{file_id=3, log_id=3962, offset=44928}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787ac050, len:434, log_data_len:306, seq:3961, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:15.516974] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE35-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:15.517084] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE35-0-0] [lt=77] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215695154310003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215695154310003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:15.522590] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.526496] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3962, offset=44928}, end_cursor:ObLogCursor{file_id=3, log_id=3963, offset=45225}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787b0050, len:4224, log_data_len:297, seq:3962, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:15.526884] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE35-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:15.526960] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE35-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215695154310003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215695154310003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:15.558192] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:15.558268] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.559771] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:15.568924] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:15.573198] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=66] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:15.573251] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:15.573275] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:15.573302] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:15.573326] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254900123430, flush_io_finished_ret_:0, flush_io_finished_round_:87, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:15.586907] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:15.600805] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:15.600869] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:15.602602] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:15.602638] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:15.615910] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:15.620582] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:15.622682] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.655364] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1745215695654460000, start_id=1745215695654460000, end_id=1745215695654460001) [2025-04-21 14:08:15.655501] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=125] handle gts request statistics(total_rt=704, total_cnt=60, avg_rt=1.154098360655737743e+01, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:08:15.655615] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=52] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:15.662172] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1827, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:15.662533] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:15.694427] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695076] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695132] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695174] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695227] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695713] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695729] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695779] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695785] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.695833] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.696411] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:15.706850] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=26] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17296846}, readable_log_tail:{lsn:17296846}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49807922, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:15.706983] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=132] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:08:15.707009] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8709337}, readable_log_tail:{lsn:8709337}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58395431, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:15.707071] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=62] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:08:15.707112] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:15.710985] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDCB-0-0] [lt=55] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:15.711200] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDCD-0-0] [lt=58] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:15.719918] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=57] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:15.721988] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=82][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65625282}], scn_array=[cnt:1, {val:1745215695707204000, v:0}], curr_size=585, accum_size=2741, time_cost=13908) [2025-04-21 14:08:15.722814] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:15.722840] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:15.722858] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.734382] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=27] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:08:15.734430] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=44] finish to resize log external storage handler(current_ts=1745215695734426, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:15.737400] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=9, gc_interval=10000000) [2025-04-21 14:08:15.737477] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=43] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:15.737507] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=25] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:15.737535] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] gc_check_member_list_ cost time(ret=0, time_us=90) [2025-04-21 14:08:15.737562] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:15.738937] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:15.740177] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:15.740233] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=47] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:15.740259] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:15.740284] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] execute_gc cost time(ret=0, time_us=54) [2025-04-21 14:08:15.740305] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyHandler start process [2025-04-21 14:08:15.759822] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD97-0-0] [lt=18] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:08:15.759895] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD97-0-0] [lt=52] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:08:15.760324] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1989, avg_log_submit_to_slide_time=2012) [2025-04-21 14:08:15.760389] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:15.770476] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=74] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:15.774257] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDCF-0-0] [lt=15] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:15.784408] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:15.805124] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:15.807504] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:9837, max_lsn:17296968, max_scn:{val:1745215695655553001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17296968}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17296846}, last_submit_end_lsn:{lsn:17296968}, last_submit_log_id:9837, last_submit_log_pid:3, max_flushed_lsn:{lsn:17296846}, max_flushed_end_lsn:{lsn:17296968}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17296968}, last_slide_log_id:9837, last_slide_scn:{val:1745215695655553001, v:0}, last_slide_lsn:{lsn:17296846}, last_slide_end_lsn:{lsn:17296968}, last_slide_log_pid:3, last_slide_log_accum_checksum:2720203742, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:9838, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17296968}, readable_log_tail:{lsn:17296968}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49807800, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:08:15.807771] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=261] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215695760314, last_flushed_end_lsn:{lsn:17296968}}]) [2025-04-21 14:08:15.807796] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=9838, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215695760314, last_flushed_end_lsn:{lsn:17296968}}]) [2025-04-21 14:08:15.807847] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:13776, max_lsn:8709459, max_scn:{val:1745215695655553001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8709459}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8709337}, last_submit_end_lsn:{lsn:8709459}, last_submit_log_id:13776, last_submit_log_pid:3, max_flushed_lsn:{lsn:8709337}, max_flushed_end_lsn:{lsn:8709459}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8709459}, last_slide_log_id:13776, last_slide_scn:{val:1745215695655553001, v:0}, last_slide_lsn:{lsn:8709337}, last_slide_end_lsn:{lsn:8709459}, last_slide_log_pid:3, last_slide_log_accum_checksum:1379356276, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:13777, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8709459}, readable_log_tail:{lsn:8709459}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58395309, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:08:15.808024] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=175] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215695760267, last_flushed_end_lsn:{lsn:8709459}}]) [2025-04-21 14:08:15.808043] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=18] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=13777, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215695760267, last_flushed_end_lsn:{lsn:8709459}}]) [2025-04-21 14:08:15.809551] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:08:15.809609] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:15.810374] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE03-0-0] [lt=34] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:15.810437] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE03-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:15.811157] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=75] ====== tenant freeze timer task ====== [2025-04-21 14:08:15.815261] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=29] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:15.815300] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=37] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=7) [2025-04-21 14:08:15.815317] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=16] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:15.815340] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=20] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:15.816453] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:15.817564] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:15.820778] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=108] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:15.822843] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.825288] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:15.858639] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:15.858706] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.860349] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:15.860412] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1907, avg_log_submit_to_slide_time=1931) [2025-04-21 14:08:15.860475] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:15.867000] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=58] BlockGCTimerTask success(ret=0, cost_time_us=13, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:15.883460] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5518) [2025-04-21 14:08:15.883516] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=2569, avg_log_submit_to_slide_time=2588) [2025-04-21 14:08:15.883581] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=54, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:15.883613] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=30] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1993, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:15.883632] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:15.883649] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-610, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:15.883667] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0000-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1437, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:15.899287] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=39][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:15.899396] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:15.900749] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDD1-0-0] [lt=26] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:15.906341] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDBC-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:15.907424] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0008-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:15.907584] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=32] LogLoopThread round_cost_time(us)(round_cost_time=597) [2025-04-21 14:08:15.909770] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0008-0-0] [lt=29][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254901460077, cache_obj->added_lc()=false, cache_obj->get_object_id()=624, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:15.911907] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=42] ls blacklist refresh finish(cost_time=8317) [2025-04-21 14:08:15.922910] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:15.937811] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:15.937862] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:15.952260] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=68] current monitor number(seq_=-1) [2025-04-21 14:08:15.958665] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:15.958748] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:15.958780] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:15.958808] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:15.958834] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:15.960301] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1783, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:15.960345] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=96, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:15.960403] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:15.960411] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=163] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:15.960444] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2012, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:15.960468] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:15.960502] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:15.960521] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1936, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:15.994230] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=71] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8263) [2025-04-21 14:08:16.003087] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF06-0-0] [lt=58] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082162618637084961e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.585687217880938533e+02) [2025-04-21 14:08:16.007668] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:16.007749] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8263, avg_group_log_size=516) [2025-04-21 14:08:16.016936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:16.022985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.025797] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4400000, replace_num=100000) [2025-04-21 14:08:16.025843] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:16.027601] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=39] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:16.030354] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=64] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:16.046237] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=16] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:16.046345] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=61] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:16.046377] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=133, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:16.046452] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:16.046529] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:16.046553] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=8, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:16.058368] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:16.058420] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.060648] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:16.084859] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:16.084925] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=60] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:16.084979] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=50] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:16.085036] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=54] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:16.088436] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=20] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:16.088736] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=296] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:16.094599] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:16.095966] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD97-0-0] [lt=40] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:08:16.096176] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1745215696095622000, start_id=1745215696095622000, end_id=1745215696095622001) [2025-04-21 14:08:16.106058] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=54][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:16.123079] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.176003] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD1-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:16.176059] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD1-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:16.204802] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8263) [2025-04-21 14:08:16.204895] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8263) [2025-04-21 14:08:16.204954] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1406, avg_log_submit_to_slide_time=1423) [2025-04-21 14:08:16.204992] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:16.205044] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8263, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:16.217455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:16.223120] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.225943] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:16.228586] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:16.228647] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:16.228847] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:16.229057] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:16.229142] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:18, schedule:1034, submit:8, rt:1370, total:2431) [2025-04-21 14:08:16.229225] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:16.229291] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:18, schedule:1034, submit:8, device:1370, total:2431) [2025-04-21 14:08:16.229353] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:16.229425] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:712, total:726) [2025-04-21 14:08:16.229501] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:16.229538] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:712, total:726) [2025-04-21 14:08:16.229598] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:16.229624] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:16.232239] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE05-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:16.232301] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE05-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:16.233162] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDBC-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:16.258943] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2025-04-21 14:08:16.259000] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:16.265547] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:16.266789] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:16.266880] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=35] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215691147050000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:16.282271] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:16.282328] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:16.282729] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=80] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:16.283653] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=87] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2518, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:16.283704] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:16.283759] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:16.283808] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2652, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:16.283834] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:16.306579] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215696107297000, v:0}, base_version={val:1745215695907398000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215696107297000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215696306557, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:16.309365] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4862) [2025-04-21 14:08:16.309537] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4862, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:16.323187] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.358907] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:16.358962] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.359019] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1644) [2025-04-21 14:08:16.360813] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1644) [2025-04-21 14:08:16.393225] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215696393221, bytes: 4166107, bw: 0.012088 MB/s, add_ts: 1007629, add_bytes: 12772 [2025-04-21 14:08:16.395975] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1302, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:16.396028] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:16.396083] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:16.396117] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1438, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:16.399646] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:08:16.399691] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:16.403578] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:16.405028] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215696202512000, v:0}, new_max_version={val:1745215696202512000, v:0}, last_min_version={val:1745215696002605000, v:0}, last_max_version={val:1745215696002605000, v:0}, total_time_us=3005, delta_us=202513) [2025-04-21 14:08:16.405073] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215696202512000, v:0}, min_version={val:1745215696202512000, v:0}, max_version={val:1745215696202512000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:16.417604] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:16.418002] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:16.422247] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:16.422314] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:08:16.422340] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:16.422370] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:16.422396] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254900972472, flush_io_finished_ret_:0, flush_io_finished_round_:88, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:16.423255] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.425430] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:16.426081] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:16.437974] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:16.438023] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.442074] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:16.452481] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215696452476, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2025-04-21 14:08:16.466506] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:16.475900] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.475960] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.476004] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.476012] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.494266] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:16.495468] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:16.495561] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215695543275000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:16.508128] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1745215696508038000, start_id=1745215696508038000, end_id=1745215696508038001) [2025-04-21 14:08:16.508235] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4862, avg_group_log_size=405) [2025-04-21 14:08:16.508273] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4862) [2025-04-21 14:08:16.523325] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.533200] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF000A-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:16.533436] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=59] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3963, offset=45225}, end_cursor:ObLogCursor{file_id=3, log_id=3964, offset=45531}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787b4050, len:3927, log_data_len:306, seq:3963, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:16.533776] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE36-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:16.533843] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE36-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215696155647002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215696155647002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:16.535528] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF000A-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254902085836, cache_obj->added_lc()=false, cache_obj->get_object_id()=625, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:16.536615] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF000E-0-0] [lt=42][errcode=-4201] hashtable not init [2025-04-21 14:08:16.536644] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF000E-0-0] [lt=28] get cursor info failed(cursor_id=30, get_sessid()=3221487630) [2025-04-21 14:08:16.536765] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF000F-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1745215696535923000, start_id=1745215696535923000, end_id=1745215696535923001) [2025-04-21 14:08:16.540407] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=74] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3964, offset=45531}, end_cursor:ObLogCursor{file_id=3, log_id=3965, offset=45828}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787b8050, len:3621, log_data_len:297, seq:3964, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:16.540748] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE36-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:16.540822] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE36-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215696155647003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215696155647003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:16.558586] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:16.558649] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.560806] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1644) [2025-04-21 14:08:16.563933] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:16.563988] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:16.569021] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:16.573460] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:16.573519] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:16.573542] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:16.573571] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:16.573596] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254901123691, flush_io_finished_ret_:0, flush_io_finished_round_:88, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:16.587079] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:16.600954] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:16.601028] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:16.602667] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:16.602732] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:16.610495] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF5A-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:16.613914] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215696613041000, start_id=1745215696613041000, end_id=1745215696613041001) [2025-04-21 14:08:16.616006] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF5E-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:16.618657] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:16.623398] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.626221] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:16.656708] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=44] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:16.656950] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=52] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215696656932], gts:1745215696656894000, latest_srr:[mts=1745215696656932]}) [2025-04-21 14:08:16.667044] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] [COMPACTION DAG STATUS] (start_time=1745215686664239, end_time=1745215696667040, dag_status={}) [2025-04-21 14:08:16.667097] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=48] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667119] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667132] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667195] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667214] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:16.667249] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667274] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667294] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667313] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667359] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667391] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667412] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667427] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667445] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667464] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667482] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667500] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667525] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667578] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667614] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667631] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667650] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667667] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667684] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667702] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667719] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667755] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667774] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667791] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667810] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667828] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667846] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667863] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667894] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667924] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667942] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667960] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667978] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.667995] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668013] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668030] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668067] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668084] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668118] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668135] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668170] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668238] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668265] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668292] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668318] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668354] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668371] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668389] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668407] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668419] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668437] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668455] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:16.668474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:16.668490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:16.668508] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:16.668522] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:16.668538] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:16.668554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:16.668569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:16.668584] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:16.668599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:16.668613] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:16.668630] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(dag_cnt=0, total_worker_cnt_=1, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:16.669058] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:08:16.669138] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=69] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:16.669198] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:16.694903] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.694960] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.694994] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695325] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695489] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695495] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695549] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695592] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.695810] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.696313] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.696851] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:16.723473] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.760853] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1625, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:16.760982] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=157] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:16.761090] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1831, avg_log_submit_to_slide_time=1857) [2025-04-21 14:08:16.761154] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1644, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:16.784534] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:16.797575] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=59] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:08:16.806751] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=23] ====== traversal_flush timer task ====== [2025-04-21 14:08:16.806844] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD98-0-0] [lt=38] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:16.806963] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD98-0-0] [lt=112] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:16.811843] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE04-0-0] [lt=22] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:16.811903] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE04-0-0] [lt=57] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:16.817638] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:16.818401] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=38] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:16.818450] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:08:16.818472] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:16.818497] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:16.818520] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254901368642, flush_io_finished_ret_:0, flush_io_finished_round_:88, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:16.819216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:16.823541] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.825432] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=34] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:16.826351] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:16.830359] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] ====== checkpoint timer task ====== [2025-04-21 14:08:16.831333] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:16.831389] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=55] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:16.831456] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:16.831542] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=82] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:16.831585] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:16.831609] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=0, rec_log_ts={val:1745215688645705001, v:0}) [2025-04-21 14:08:16.831627] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:16.831645] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:16.831666] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:16.831696] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:16.831718] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:16.831747] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:16.831778] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:16.831796] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:16.859071] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:16.859132] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.861164] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:08:16.861222] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1756, avg_log_submit_to_slide_time=1773) [2025-04-21 14:08:16.861298] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:16.884125] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4093) [2025-04-21 14:08:16.884174] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=1388, avg_log_submit_to_slide_time=1404) [2025-04-21 14:08:16.893150] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=55] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:16.912316] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=55] blacklist_loop exec finished(cost_time=24, is_enabled=true, send_cnt=0) [2025-04-21 14:08:16.913097] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0010-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:16.915517] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0010-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254902465822, cache_obj->added_lc()=false, cache_obj->get_object_id()=626, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:16.923609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:16.929236] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=50] runTimer to refresh locality_info(ret=0) [2025-04-21 14:08:16.931094] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=51] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:08:16.931148] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=44] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:08:16.931170] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=22] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:08:16.931196] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=20] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:08:16.931213] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:08:16.931235] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:08:16.931251] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:08:16.931271] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:08:16.938136] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:16.938184] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:16.942539] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8D-0-0] [lt=36] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215691987599, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:16.942589] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8D-0-0] [lt=49] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215691989311, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:16.942609] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8D-0-0] [lt=18] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215691990636, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215691990632, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:16.952371] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:08:16.959420] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:16.959493] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:16.959526] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:08:16.959556] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:08:16.959582] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:16.961147] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:16.961151] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=421] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1634, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:16.961189] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1774, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:16.961207] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=71, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:16.961232] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:16.961253] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1896, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:16.961274] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:16.961090] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:16.994937] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8261) [2025-04-21 14:08:16.999922] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:16.999956] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=34] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:16.999967] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAA-0-0] [lt=33] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:17.000010] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAA-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:17.003751] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF0B-0-0] [lt=35] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082162618637084961e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.585687217880938533e+02) [2025-04-21 14:08:17.005485] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:17.008368] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215697007451000, start_id=1745215697007451000, end_id=1745215697007451001) [2025-04-21 14:08:17.008491] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:17.008542] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8261, avg_group_log_size=516) [2025-04-21 14:08:17.019740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:17.023674] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.026481] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=35] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:17.030529] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=74] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:17.058765] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:17.058824] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.061186] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=339] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:08:17.082803] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:17.082852] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] try gc retain ctx [2025-04-21 14:08:17.082874] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] try to retry start_working [2025-04-21 14:08:17.082929] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] finish update min start scn(max_decided_scn={val:1745215696907950000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215686897989001, v:0}, keep_alive_scn_:{val:1745215691901613001, v:0}, update_ts_:1745215697082379}) [2025-04-21 14:08:17.084509] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215705197259000, latest_log_ts:{val:1745215688645705001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:17.102580] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215697003169000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215697102533}, version_delta=99408) [2025-04-21 14:08:17.107107] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215696907950000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199149, in_cluster_service=true, cluster_version={val:1745215696707409000, v:0}, min_cluster_version={val:1745215696707409000, v:0}, max_cluster_version={val:1745215696707409000, v:0}, get_cluster_version_err=0, cluster_version_delta=399690, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=783, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=34637236, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:17.109936] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:17.123742] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.157252] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=37] ts response task statistics(alloc_count=1878, free_count=938) [2025-04-21 14:08:17.157331] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=64] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=359, get_gts_with_stc_cnt=31, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=30, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:17.177841] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD2-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:17.177898] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD2-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:17.205573] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8260) [2025-04-21 14:08:17.205669] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8260) [2025-04-21 14:08:17.205726] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1403, avg_log_submit_to_slide_time=1417) [2025-04-21 14:08:17.205756] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:17.205802] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8260, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:17.220226] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:17.223809] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.226611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:17.229331] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=9600000, clean_num=200000) [2025-04-21 14:08:17.230612] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:17.230671] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:17.230870] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:17.231052] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:17.231136] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:19, schedule:40, submit:9, rt:1223, total:1292) [2025-04-21 14:08:17.231213] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:17.231275] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:19, schedule:40, submit:9, device:1223, total:1292) [2025-04-21 14:08:17.231339] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:17.231412] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:672, total:687) [2025-04-21 14:08:17.231493] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:17.231531] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:672, total:687) [2025-04-21 14:08:17.231592] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:17.231619] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:17.233970] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE06-0-0] [lt=21] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:17.234032] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE06-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:17.234973] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAF-0-0] [lt=55] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:17.235038] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDAF-0-0] [lt=57] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=68) [2025-04-21 14:08:17.259638] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:17.259692] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:17.282973] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=146] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:17.283027] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:17.284379] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1676, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:17.284432] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:17.284471] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:17.284507] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1785, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:17.284535] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:17.310390] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4084) [2025-04-21 14:08:17.310556] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4084, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:17.323889] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.359253] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:17.359319] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.359712] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:17.361599] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:17.397154] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1362, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:17.397232] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=67] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:17.397291] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:17.397336] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1473, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:17.400833] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215697400828, bytes: 4180330, bw: 0.013462 MB/s, add_ts: 1007607, add_bytes: 14223 [2025-04-21 14:08:17.404612] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:17.406248] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215697203873000, v:0}, new_max_version={val:1745215697203873000, v:0}, last_min_version={val:1745215697003169000, v:0}, last_max_version={val:1745215697003169000, v:0}, total_time_us=3438, delta_us=202371) [2025-04-21 14:08:17.406298] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215697203873000, v:0}, min_version={val:1745215697203873000, v:0}, max_version={val:1745215697203873000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:17.417685] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:17.422538] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:17.422602] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=55] temporary file module use no blocks [2025-04-21 14:08:17.422630] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:17.422659] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:17.422699] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=38] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254901972760, flush_io_finished_ret_:0, flush_io_finished_round_:89, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:17.423956] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.425630] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:17.426756] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:17.429871] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:17.438315] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:17.438370] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.460105] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215697460097, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2025-04-21 14:08:17.475701] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.475775] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.475817] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=20] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.476091] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.485832] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB2-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:17.509885] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=62] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4084, avg_group_log_size=371) [2025-04-21 14:08:17.509955] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4084) [2025-04-21 14:08:17.524028] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.533408] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0012-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:17.536048] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0012-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254903086355, cache_obj->added_lc()=false, cache_obj->get_object_id()=627, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:17.537357] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=57] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:17.548051] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3965, offset=45828}, end_cursor:ObLogCursor{file_id=3, log_id=3966, offset=46134}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787bc050, len:3324, log_data_len:306, seq:3965, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:17.548413] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE37-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:17.548487] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE37-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215697156706003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215697156706003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:17.554700] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3966, offset=46134}, end_cursor:ObLogCursor{file_id=3, log_id=3967, offset=46431}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787c0050, len:3018, log_data_len:297, seq:3966, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:17.554963] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE37-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:17.555018] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE37-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215697156706003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215697156706003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:17.558937] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:17.558985] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.569106] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=33] gc stale ls task succ [2025-04-21 14:08:17.587236] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:17.598840] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=25] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:17.598894] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=42] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=18) [2025-04-21 14:08:17.601717] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:17.601776] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:17.603832] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:17.603876] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:17.619405] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:17.620619] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=51] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:17.620711] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215688723282000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:17.624101] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.626897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:17.630429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:17.657798] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:17.657858] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=45] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215697657843], gts:1745215697657175000, latest_srr:[mts=1745215697657843]}) [2025-04-21 14:08:17.661896] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=32, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:17.661948] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=51] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=1830, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:17.661964] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:17.661977] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=-496, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:17.661990] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=1366, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:17.662104] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:08:17.687146] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=39] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585099124736, fast_delete_log_mode=false) [2025-04-21 14:08:17.695306] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695520] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695582] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695567] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695624] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695844] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695855] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695899] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695905] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.695941] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.696413] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:17.724178] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.761995] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1711, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:17.761988] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1817, avg_log_submit_to_slide_time=1835) [2025-04-21 14:08:17.762107] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:17.762180] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:17.777741] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=52] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:17.779081] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=95] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:17.784654] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:17.809730] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:08:17.809785] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:17.812965] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:17.813498] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE05-0-0] [lt=15] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:17.813598] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE05-0-0] [lt=95] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:17.817728] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:17.818640] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:17.818712] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=62] temporary file module use no blocks [2025-04-21 14:08:17.818736] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:17.818762] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:17.818785] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254902368874, flush_io_finished_ret_:0, flush_io_finished_round_:89, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:17.824242] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.825598] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:17.827028] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:17.830949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:17.854658] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=66] LogLoopThread round_cost_time(us)(round_cost_time=25) [2025-04-21 14:08:17.859450] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:17.859508] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.862046] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:17.862104] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1813, avg_log_submit_to_slide_time=1826) [2025-04-21 14:08:17.862165] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:17.884917] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:08:17.884971] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1984, avg_log_submit_to_slide_time=2002) [2025-04-21 14:08:17.919592] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0014-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:17.922012] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0014-0-0] [lt=48][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254903472319, cache_obj->added_lc()=false, cache_obj->get_object_id()=628, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:17.922576] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=39] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:17.924314] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:17.938496] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:17.938549] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:17.952508] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:08:17.960161] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:17.960240] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:17.960274] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:17.960306] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:17.960333] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:17.962075] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:17.962142] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:17.962184] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1861, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:17.962173] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1710, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:17.962210] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=79, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:17.962239] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:17.962271] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1889, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:17.962294] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:17.995726] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8260) [2025-04-21 14:08:18.004894] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF10-0-0] [lt=22] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082162618637084961e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.585687217880938533e+02) [2025-04-21 14:08:18.009486] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFDD6-0-0] [lt=71] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:08:18.010444] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:18.010542] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8260, avg_group_log_size=516) [2025-04-21 14:08:18.024388] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.027164] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:18.030657] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=44] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:18.031438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:18.059128] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:18.059199] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.062068] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:18.124457] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.158240] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215698158205], gts:1745215698157130000, latest_srr:[mts=1745215698158205]}) [2025-04-21 14:08:18.179691] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD3-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:18.179850] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD3-0-0] [lt=156] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:18.197619] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=25824086, this={dio_aligned_buf:{buf_write_offset:3024, buf_padding_size:1072, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4619, truncate_used_ts:1894}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=25821184, buf_len=122, total_write_size=86261, total_write_size_after_dio=786432, ob_pwrite_used_ts=250584, count=171, each_pwrite_cost=1465) [2025-04-21 14:08:18.204931] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF11-0-0] [lt=61] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215698204527, can_tenant_elr:true}) [2025-04-21 14:08:18.206960] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=90] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8261) [2025-04-21 14:08:18.207097] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8261) [2025-04-21 14:08:18.207168] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1538, avg_log_submit_to_slide_time=1557) [2025-04-21 14:08:18.207208] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:18.207253] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8261, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:18.207338] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:18.224524] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.231906] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:18.232145] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4500000, replace_num=100000) [2025-04-21 14:08:18.232197] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:18.232608] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:18.232665] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:18.232843] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:18.233045] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:18.233133] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:19, schedule:43, submit:9, rt:1658, total:1730) [2025-04-21 14:08:18.233211] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:18.233276] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:19, schedule:43, submit:9, device:1658, total:1730) [2025-04-21 14:08:18.233331] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:18.233402] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:851, total:867) [2025-04-21 14:08:18.233479] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:18.233516] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:851, total:867) [2025-04-21 14:08:18.233574] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:18.233600] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:18.235472] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE07-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:18.235537] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE07-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.260403] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:18.260471] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:18.283764] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:18.283854] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:18.285351] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1567, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:18.285409] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:18.285456] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:18.285492] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1709, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:18.285517] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:18.300237] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=91] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:18.311641] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3533) [2025-04-21 14:08:18.311855] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3533, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:18.324591] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.359646] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:18.359716] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.360481] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:18.362312] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:18.397939] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=81] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1442, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:18.398019] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:18.398069] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:18.398113] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1576, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:18.399826] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:18.399873] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:18.405140] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:18.406642] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215698204527000, v:0}, new_max_version={val:1745215698204527000, v:0}, last_min_version={val:1745215698004721000, v:0}, last_max_version={val:1745215698004721000, v:0}, total_time_us=3002, delta_us=202112) [2025-04-21 14:08:18.406696] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215698204527000, v:0}, min_version={val:1745215698204527000, v:0}, max_version={val:1745215698204527000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:18.408447] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1745215698408443, bytes: 4193102, bw: 0.012088 MB/s, add_ts: 1007615, add_bytes: 12772 [2025-04-21 14:08:18.417752] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:18.422838] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:18.422901] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=52] temporary file module use no blocks [2025-04-21 14:08:18.422920] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:18.422952] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:18.422978] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254902973063, flush_io_finished_ret_:0, flush_io_finished_round_:90, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:18.424660] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.425827] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:18.432318] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:18.432440] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:18.438680] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:18.438749] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.451658] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:18.467715] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1745215698467709, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2025-04-21 14:08:18.468237] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:18.475342] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.475409] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.475451] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.476013] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.511033] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2025-04-21 14:08:18.511117] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=76] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3533) [2025-04-21 14:08:18.524731] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.554929] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=48] clear dtl interm result cost(us)(clear_cost=395, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:18.556867] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620317][T1002_Compactio][T1002][YB420B1D7AB6-00063343B84EFD88-0-0] [lt=42] InfoPoolResizeTask(cost_ts=14) [2025-04-21 14:08:18.559332] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:18.559393] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.561015] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:08:18.561134] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD97-0-0] [lt=39] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215698157130003, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215695154310003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:18.561295] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD97-0-0] [lt=124] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215695154310003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:18.561367] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD97-0-0] [lt=69] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:18.561443] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3967, offset=46431}, end_cursor:ObLogCursor{file_id=3, log_id=3968, offset=46737}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787c4050, len:2721, log_data_len:306, seq:3967, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:18.561810] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE38-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:18.561861] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE38-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215698157130003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215698157130003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:18.561974] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=54, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:18.562015] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=40] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=1903, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:18.562036] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:18.562055] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=-527, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:18.562073] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF5D-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=1429, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:18.564135] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:18.564193] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:18.565353] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE38-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1745215698565194000, start_id=1745215698565194000, end_id=1745215698565194001) [2025-04-21 14:08:18.568132] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3968, offset=46737}, end_cursor:ObLogCursor{file_id=3, log_id=3969, offset=47034}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787c8050, len:2415, log_data_len:297, seq:3968, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:18.568484] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE38-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:18.568549] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE38-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215698157130003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215698157130003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:18.569189] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:18.573764] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:18.573815] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:18.573840] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:18.573866] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:18.573890] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254903124000, flush_io_finished_ret_:0, flush_io_finished_round_:90, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:18.587395] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:18.601079] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:18.601138] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:18.602941] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:18.602979] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:18.607960] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=65][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:18.624800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.625352] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:18.626395] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=38] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:18.626456] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:18.626524] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=32] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215696155647003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:18.626629] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=99] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:18.626656] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:18.626690] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215694153093001, v:0}) [2025-04-21 14:08:18.626712] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:18.626736] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:18.626768] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:18.626791] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:18.626822] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:18.626854] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:18.627897] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:18.627942] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=44] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:18.627997] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215696155647003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:18.628065] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=66] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:18.628087] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:18.628109] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:18.628132] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:18.628153] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:18.628175] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:18.628201] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:18.628219] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:18.628276] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:18.628466] WDIAG read_multi_row (ob_table_access_helper.h:238) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:18.630855] INFO delete_row (ob_table_access_helper.h:312) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215698628504) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215698628504) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:18.631069] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=53] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:18.632442] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:18.632901] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:18.649816] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=55] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:18.658836] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=66] submit log success(service_type_=0, last_id=1745215715197259000, limited_id=1745215715197259000) [2025-04-21 14:08:18.658897] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=60] submit log with lock success(service_type_=0, last_id=1745215715197259000, limited_id=1745215715197259000) [2025-04-21 14:08:18.658938] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:18.660488] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF000F-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215715197259000, latest_scn={val:1745215698658513001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:18.660582] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF000F-0-0] [lt=93] handle submit callback(service_type_=0, success=true, used_ts=1750, log_ts={val:1745215698658513001, v:0}, limited_id=1745215715197259000) [2025-04-21 14:08:18.660614] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF000F-0-0] [lt=30] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:18.660636] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF000F-0-0] [lt=21] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:18.661815] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:18.670410] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2025-04-21 14:08:18.670502] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=76] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:18.670561] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:18.674296] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE06-0-0] [lt=23] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.677130] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=31] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745300457074037, last_date_:0, this_date_:0, next_date_:1745300457074037, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:18.677253] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=122] check all tenants(ret=0) [2025-04-21 14:08:18.678567] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE09-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.679875] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0A-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.681190] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0B-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.682726] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0C-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.684055] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0D-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.685513] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0E-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.686839] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=31][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:18.686942] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=42][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:18.689510] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE0F-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.695042] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695115] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695154] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695280] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695360] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695394] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695419] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695772] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695821] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.695855] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.696201] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=51] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:18.708073] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=42] ObArchiveSender is running(thread_index=0) [2025-04-21 14:08:18.713555] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDCF-0-0] [lt=32] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:18.724952] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:18.724982] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:18.725000] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.760711] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:18.760774] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=61] try gc retain ctx [2025-04-21 14:08:18.760793] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] try to retry start_working [2025-04-21 14:08:18.760869] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] finish update min start scn(max_decided_scn={val:1745215698658513000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215688646785001, v:0}, keep_alive_scn_:{val:1745215693652605001, v:0}, update_ts_:1745215698760286}) [2025-04-21 14:08:18.761720] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD99-0-0] [lt=40] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:18.762463] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215696155647003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:18.762713] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=141] finish update min start scn(max_decided_scn={val:1745215698658513000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215688646785001, v:0}, keep_alive_scn_:{val:1745215693652605001, v:0}, update_ts_:1745215698762412}) [2025-04-21 14:08:18.764133] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215696155647003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:18.764320] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1685, avg_log_submit_to_slide_time=1704) [2025-04-21 14:08:18.764396] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:18.765437] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1517, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:18.765586] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:18.776640] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDD1-0-0] [lt=44] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:18.784769] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:18.815508] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE10-0-0] [lt=37] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:18.815578] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE10-0-0] [lt=67] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:18.817816] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:18.823135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=25] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000) [2025-04-21 14:08:18.823184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=48] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.823974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824121] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824927] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.824980] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.825086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825424] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825819] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:18.825895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.825959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826558] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.826961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827031] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:18.827078] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:18.827093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827721] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] update_check_range(min_check_version=8, max_check_version=9, global_version=10) [2025-04-21 14:08:18.827744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.827938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828818] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.828948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829106] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829686] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.829942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830927] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.830995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831685] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.831941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832555] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:18.832652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.832983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:18.833758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.833941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.834946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835010] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.835951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.836986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.837992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838563] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.838967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839229] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.839938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.840974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841059] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841272] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.841986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.842975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.843971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844686] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.844951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.845989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.846990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.847951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848800] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.848998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.849971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.850938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.851956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852686] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852682] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 163 249 0 1 2 87 1 0 1 4 1 1 0 1 5 43 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 233 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 21 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 86 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 20 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 92 245 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 25004 [2025-04-21 14:08:18.852747] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,070,678,016 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 458,289,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 90,177,536 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:18.852752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.852956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853165] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 458,289,152 used= 382,012,272 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 28 [MEMORY] hold= 91,103,232 used= 90,923,584 count= 55 avg_used= 1,653,156 block_cnt= 55 chunk_cnt= 46 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,694,016 used= 4,128,768 count= 69 avg_used= 59,837 block_cnt= 69 chunk_cnt= 12 mod=[T]char [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,150,464 used= 3,020,064 count= 652 avg_used= 4,632 block_cnt= 652 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,374,720 used= 1,301,088 count= 36 avg_used= 36,141 block_cnt= 36 chunk_cnt= 10 mod=CommSysVarFac [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,179,648 used= 1,159,936 count= 8 avg_used= 144,992 block_cnt= 8 chunk_cnt= 8 mod=SQLSessionInfo [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 601,472 used= 587,264 count= 74 avg_used= 7,936 block_cnt= 74 chunk_cnt= 13 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 369,408 used= 354,432 count= 78 avg_used= 4,544 block_cnt= 78 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 195,072 used= 190,464 count= 24 avg_used= 7,936 block_cnt= 24 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 83,016 count= 9 avg_used= 9,224 block_cnt= 9 chunk_cnt= 6 mod=[T]ObDSActionAr [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,464 used= 6,144 count= 12 avg_used= 512 block_cnt= 11 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 382,012,272 used= 373,900,748 count= 32,157 avg_used= 11,627 mod=SUMMARY [2025-04-21 14:08:18.853231] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=51] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:08:18.853259] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:08:18.853256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853289] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 90,177,536 used= 86,713,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 81,809,536 used= 74,307,679 count= 3,701 avg_used= 20,077 block_cnt= 3,701 chunk_cnt= 43 mod=SqlPhyPlan [MEMORY] hold= 3,484,992 used= 3,278,864 count= 360 avg_used= 9,107 block_cnt= 360 chunk_cnt= 43 mod=SqlPlanCache [MEMORY] hold= 1,416,576 used= 1,291,584 count= 651 avg_used= 1,984 block_cnt= 217 chunk_cnt= 42 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 86,713,088 used= 78,879,727 count= 4,714 avg_used= 16,733 mod=SUMMARY [2025-04-21 14:08:18.853322] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:08:18.853324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853347] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:08:18.853390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853394] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:08:18.853421] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:08:18.853446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:18.853456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853470] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:18.853495] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:08:18.853523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853532] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,675,136 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,804,416 used= 1,761,792 count= 222 avg_used= 7,936 block_cnt= 222 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,675,136 used= 19,603,520 count= 226 avg_used= 86,741 mod=SUMMARY [2025-04-21 14:08:18.853561] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:08:18.853589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853598] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:08:18.853632] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 774,303,744 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 225,513,472 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:18.853655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.853919] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,124,640 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:18.860278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860310] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=239] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.860343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.860947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.861977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.862987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863659] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.863934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864375] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:18.864482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864479] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=77] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1758, avg_log_submit_to_slide_time=1778) [2025-04-21 14:08:18.864555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864559] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:18.864624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.864957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.865986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.866941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.867952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.868977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.869943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1001}, tablet_id={id:200589}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.870997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=38] get multi version start(ls_id={id:1001}, tablet_id={id:200426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200876}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200929}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200529}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201384}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200608}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200127}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200810}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.871946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200767}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200999}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:201235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200822}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201318}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200874}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200971}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200880}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201270}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200347}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:201081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.872993] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=37] get multi version start(ls_id={id:1001}, tablet_id={id:201151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201126}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200976}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200913}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200566}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200312}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201205}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200690}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200193}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200911}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.873974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200301}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200703}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200808}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=15] get multi version start(ls_id={id:1001}, tablet_id={id:200130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201138}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200707}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200314}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200662}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.874971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200492}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200893}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200275}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200725}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200678}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200300}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200304}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200739}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=26] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846997}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.875996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200799}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200691}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201289}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200867}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=33] get multi version start(ls_id={id:1001}, tablet_id={id:200732}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200706}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.876971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200746}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877144] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:18.877201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200264}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200271}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200764}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200533}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200747}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.877935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200163}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200183}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606847002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1001}, tablet_id={id:200136}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200950}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=32] get multi version start(ls_id={id:1001}, tablet_id={id:200109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200731}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200997}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.878937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200914}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200882}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200310}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200700}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879332] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1745215698878983000, start_id=1745215698878983000, end_id=1745215698878983001) [2025-04-21 14:08:18.879403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200448}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200918}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200178}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.879988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200951}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201414}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200664}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200534}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200199}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200677}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200122}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201194}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200579}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.880973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200184}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201278}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201258}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200946}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200755}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200975}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200798}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200270}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.881970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200967}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201234}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200718}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200582}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200748}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200759}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200576}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200815}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200612}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=30] get multi version start(ls_id={id:1001}, tablet_id={id:200938}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200598}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200618}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.882941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200692}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200745}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200654}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200645}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200171}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200545}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200708}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200699}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200204}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846986}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200663}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846977}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.883974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200537}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884293] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200781}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=24] get multi version start(ls_id={id:1001}, tablet_id={id:200283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=15] get multi version start(ls_id={id:1001}, tablet_id={id:200959}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200925}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200854}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.884955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200909}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200696}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200643}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200714}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200760}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200779}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885573] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200346}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200887}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200742}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200523}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.885967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886140] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3539) [2025-04-21 14:08:18.886171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886214] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1691) [2025-04-21 14:08:18.886240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200996}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200557}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201346}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200875}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200740}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200665}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200337}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.886982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887111] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200711}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200982}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200286}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200756}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200751}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.887988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200340}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200565}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200811}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846980}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200868}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200659}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.888991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200869}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=35] get multi version start(ls_id={id:1001}, tablet_id={id:200717}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201281}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200801}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889272] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201186}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200605}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200743}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200930}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200712}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200674}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200931}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.889935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200915}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200919}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200785}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200597}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201229}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200686}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200200}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201341}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200948}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201178}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.890996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200935}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201136}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200922}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.891381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=20] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:08:18.896075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=2] get multi version start(ls_id={id:1001}, tablet_id={id:201363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.900938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:200438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.903779] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDD3-0-0] [lt=28] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:18.906274] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDBE-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215698906236}) [2025-04-21 14:08:18.906398] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDBE-0-0] [lt=68] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215698906389}) [2025-04-21 14:08:18.906392] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCF-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215698906333, sql_renew_time:1745215698906333, is_mark_fail:false}]) [2025-04-21 14:08:18.906468] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDCF-0-0] [lt=74] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215698906236}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215698906333, sql_renew_time:1745215698906333, is_mark_fail:false}]) [2025-04-21 14:08:18.906531] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD0-0-0] [lt=31] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:18.907037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=4] get multi version start(ls_id={id:1001}, tablet_id={id:200564}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.907204] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD0-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215698907185, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:18.907244] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD0-0-0] [lt=39] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215698906389}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215698907185, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:18.908051] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215698658513000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=249514, in_cluster_service=true, cluster_version={val:1745215698157130004, v:0}, min_cluster_version={val:1745215698157130004, v:0}, max_cluster_version={val:1745215698157130004, v:0}, get_cluster_version_err=0, cluster_version_delta=750897, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=775, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=29783763, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:18.908985] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDBE-0-0] [lt=33] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:18.913922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:200783}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.917467] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=74] start to print blacklist info [2025-04-21 14:08:18.917750] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=57] ls blacklist refresh finish(cost_time=14017) [2025-04-21 14:08:18.920082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=2] get multi version start(ls_id={id:1001}, tablet_id={id:200164}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.924820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=2] get multi version start(ls_id={id:1001}, tablet_id={id:200729}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.925061] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:18.926309] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0016-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:18.928956] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0016-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254904479262, cache_obj->added_lc()=false, cache_obj->get_object_id()=629, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:18.929574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:200075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.934299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:200519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.938851] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:18.938910] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:18.938942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:201028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.943505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] get multi version start(ls_id={id:1001}, tablet_id={id:200970}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.948034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=2] get multi version start(ls_id={id:1001}, tablet_id={id:200789}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213891147050000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213881136928000, max_merged_snapshot=1) [2025-04-21 14:08:18.950417] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD88-0-0] [lt=3] SSTableGCTask(cost_ts=127591) [2025-04-21 14:08:18.960957] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=98] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:18.961100] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=87] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:18.961153] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:18.961201] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:18.961241] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:18.962812] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1673, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:18.962866] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=64, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:18.962926] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:18.962971] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1857, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:18.963001] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:18.963037] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:18.962983] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:18.963052] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1793, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:18.996570] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=10016) [2025-04-21 14:08:18.997704] INFO [SHARE] run1 (ob_dynamic_thread_pool.cpp:594) [619612][qth_mgr][T0][Y0-0000000000000000-0-0] [lt=67] [thread pool stat](pool_stat={pool:0x7f3c901e9480, last_check_time:1745215698997698, last_idle_time:100657077, last_thread_count:1}, *pool={name:IO_SYNC_CH, this:0x7f3c901e9480, min_thread_cnt:1, max_thread_cnt:96, running_thread_cnt:0, threads_idle_time:100657077, tenant_id:500}, qsize=-1, current_idle_time=100657077) [2025-04-21 14:08:18.998641] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:18.998709] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=67] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=1574, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:18.998727] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:18.998741] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=-523, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:18.998763] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=21] [APPLY STAT CB TOTAL TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=1111, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:19.000752] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:19.000794] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=42] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:19.000785] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAB-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:19.000820] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAB-0-0] [lt=31] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:19.004281] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215698805195000, v:0}, base_version={val:1745215698604856000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215698805195000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215699004190, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:19.006176] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF15-0-0] [lt=78] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=404, Holding Memory(MB)=68, Tenant Remain Memory(MB)=560, Usable Remain Memory(MB)=336, Last Update Limit Timestamp=1745215699005388, Is Updated=true) [2025-04-21 14:08:19.006233] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF15-0-0] [lt=54] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082162618637084961e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.585687217880938533e+02) [2025-04-21 14:08:19.008669] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] get_max_applied_scn(scn={val:1745215698910316000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65637732}, palf_committed_end_scn_:{val:1745215698910316000, v:0}, last_check_scn_:{val:1745215698910316000, v:0}, max_applied_cb_scn_:{val:1745215698910316000, v:0}}) [2025-04-21 14:08:19.008750] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get_max_applied_scn(scn={val:1745215698878983000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25829417}, palf_committed_end_scn_:{val:1745215699006475000, v:0}, last_check_scn_:{val:1745215699006475000, v:0}, max_applied_cb_scn_:{val:1745215698878983000, v:0}}) [2025-04-21 14:08:19.008735] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65637732}, readable_log_tail:{lsn:65637732}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1467036, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:19.008824] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25829417}, readable_log_tail:{lsn:25829417}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41275351, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:19.025131] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.030815] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=53] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:19.032749] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=95] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:19.034344] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:19.040439] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:19.040500] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=56] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:19.040525] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:19.040541] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:19.043785] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:19.044211] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=422] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:19.046735] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:19.046863] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=78] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:19.046902] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=138, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:19.046984] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:19.047056] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:19.047077] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=8, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:19.051921] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=56] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:136277250, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:59, recv_lp_rpc_cnt:0, recv_mysql_cnt:831, recv_task_cnt:66, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:288174, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:41, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:82, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:342, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=2, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:08:19.052718] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=794] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:08:19.052755] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=36] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:7660955, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:492999, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:08:19.053469] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=712] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:08:19.053486] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=17] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:6320596, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:246443, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:08:19.054115] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=628] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:08:19.054129] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=13] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:41541388, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:77, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:37359, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:330, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:08:19.054765] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=634] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:08:19.054789] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=23] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:67521831, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:492, recv_task_cnt:50, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:36283, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:153, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215681312860}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:638, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=20, token_change_ts:1745215608569663, tenant_role:1}) [2025-04-21 14:08:19.055389] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=598] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:08:19.059571] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:19.059646] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.062750] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:19.099235] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=121] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:19.119784] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:19.125207] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.159658] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=366, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:19.181768] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD4-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:19.181826] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD4-0-0] [lt=55] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:19.196602] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=85] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:19.196658] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=10138, avg_group_log_size=533) [2025-04-21 14:08:19.207755] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=10016) [2025-04-21 14:08:19.207843] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10016) [2025-04-21 14:08:19.207900] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1555, avg_log_submit_to_slide_time=1573) [2025-04-21 14:08:19.207934] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:19.207970] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10016, hit_cnt=19, read_cnt=19, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:19.211574] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=96] get_max_applied_scn(scn={val:1745215698658513004, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17301531}, palf_committed_end_scn_:{val:1745215699159535000, v:0}, last_check_scn_:{val:1745215699159535000, v:0}, max_applied_cb_scn_:{val:1745215698658513004, v:0}}) [2025-04-21 14:08:19.211630] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17301531}, readable_log_tail:{lsn:17301531}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49803237, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:19.225288] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.232904] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:19.234308] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=51] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:19.234749] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:19.234813] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:19.234907] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=87] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:19.234995] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:19.235178] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:19.235266] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:16, schedule:35, submit:8, rt:1365, total:1424) [2025-04-21 14:08:19.235341] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:19.235404] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:16, schedule:35, submit:8, device:1365, total:1424) [2025-04-21 14:08:19.235465] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:19.235546] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:930, total:943) [2025-04-21 14:08:19.235625] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:19.235666] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:930, total:943) [2025-04-21 14:08:19.235728] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:19.235705] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB0-0-0] [lt=56] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:19.235755] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:19.235758] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB0-0-0] [lt=42] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=55) [2025-04-21 14:08:19.237266] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE08-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:19.237329] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE08-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:19.244255] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=9800000, clean_num=200000) [2025-04-21 14:08:19.261206] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:19.261262] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:19.271421] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=41] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:19.272277] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:19.273533] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:19.273642] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215691147050000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:19.284483] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:19.284552] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:19.286319] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1662, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:19.286436] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=101] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:19.286504] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:19.286567] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1841, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:19.286605] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:19.308488] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=96] get_max_applied_scn(scn={val:1745215699159535000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8714342}, palf_committed_end_scn_:{val:1745215699159535001, v:0}, last_check_scn_:{val:1745215699159535001, v:0}, max_applied_cb_scn_:{val:1745215699159535000, v:0}}) [2025-04-21 14:08:19.308658] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=164] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8714342}, readable_log_tail:{lsn:8714342}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58390426, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:19.312433] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3541) [2025-04-21 14:08:19.312784] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3541, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:19.325040] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD1-0-0] [lt=26] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:19.325365] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.325635] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD1-0-0] [lt=49] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215699325610, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:19.325680] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD1-0-0] [lt=44] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215699324963}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215699325610, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:19.360453] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:19.360569] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=104] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.361418] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:19.363416] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:19.390447] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFDD6-0-0] [lt=65][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:08:19.396701] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:08:19.396997] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD98-0-0] [lt=146] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215699209645000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:19.397232] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD98-0-0] [lt=222] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:19.398283] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:19.398366] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=67] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:19.398410] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=38] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=19) [2025-04-21 14:08:19.398651] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1469, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:19.398741] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=76] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:19.398803] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:19.398840] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1595, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:19.407282] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=109] get number(ret=0, service_type_=0, range=1, base_id=1745215699406424000, start_id=1745215699406424000, end_id=1745215699406424001) [2025-04-21 14:08:19.407473] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:19.409394] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215699205385000, v:0}, new_max_version={val:1745215699205385000, v:0}, last_min_version={val:1745215699006475000, v:0}, last_max_version={val:1745215699006475000, v:0}, total_time_us=4872, delta_us=204005) [2025-04-21 14:08:19.409463] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215699205385000, v:0}, min_version={val:1745215699205385000, v:0}, max_version={val:1745215699205385000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:19.409514] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:19.416120] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215699416113, bytes: 4208311, bw: 0.014394 MB/s, add_ts: 1007670, add_bytes: 15209 [2025-04-21 14:08:19.417835] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:19.423119] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:19.423173] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:19.423200] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:19.423222] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:19.423241] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254903973339, flush_io_finished_ret_:0, flush_io_finished_round_:91, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:19.425443] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.425496] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:19.426024] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:19.426513] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:19.426590] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=76] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:19.426664] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:19.426791] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=121] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:19.426839] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:19.426867] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215691400073001, v:0}) [2025-04-21 14:08:19.426889] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:19.426914] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:19.426940] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:19.426973] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:19.426996] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:19.427028] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:19.427062] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:19.427083] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:19.433080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:19.439075] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:19.439163] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=79] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.444866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:19.463702] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=45] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:19.475353] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1745215699475344, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2025-04-21 14:08:19.475464] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.475536] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.475599] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.476101] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.493666] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB3-0-0] [lt=38] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:19.502871] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:19.504665] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=55] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:19.504797] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=52] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215695543275000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:19.525515] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.559767] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:19.559839] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.569261] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:19.574028] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:19.574082] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:19.574109] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:19.574137] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:19.574228] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=89] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254904124246, flush_io_finished_ret_:0, flush_io_finished_round_:91, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:19.574618] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3969, offset=47034}, end_cursor:ObLogCursor{file_id=3, log_id=3970, offset=47340}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787cc050, len:2118, log_data_len:306, seq:3969, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:19.575020] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE39-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:19.575092] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE39-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215699159535003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215699159535003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:19.583415] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3970, offset=47340}, end_cursor:ObLogCursor{file_id=3, log_id=3971, offset=47637}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787d0050, len:1812, log_data_len:297, seq:3970, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:19.583727] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE39-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:19.583778] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE39-0-0] [lt=34] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215699159535003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215699159535003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:19.587559] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:19.596845] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=22] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:19.596892] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=46] try gc retain ctx [2025-04-21 14:08:19.596907] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:19.596951] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215699410724000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215689441834001, v:0}, keep_alive_scn_:{val:1745215694511261001, v:0}, update_ts_:1745215699596570}) [2025-04-21 14:08:19.597947] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215707945792000, latest_log_ts:{val:1745215691400073001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:19.600947] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:19.600994] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:19.602759] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:19.602795] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:19.625580] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.633283] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=117] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:19.645530] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:19.651686] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:19.651755] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=48] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=17) [2025-04-21 14:08:19.652524] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:19.652580] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:19.652604] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:19.652624] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=17) [2025-04-21 14:08:19.659955] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=62] get number(ret=0, service_type_=0, range=1, base_id=1745215699658978000, start_id=1745215699658978000, end_id=1745215699658978001) [2025-04-21 14:08:19.660057] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=82] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:19.660106] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=414, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:19.660808] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215699660788], gts:1745215699660043000, latest_srr:[mts=1745215699660788]}) [2025-04-21 14:08:19.663934] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:19.684868] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3663, avg_group_log_size=333) [2025-04-21 14:08:19.684978] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=102] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4126) [2025-04-21 14:08:19.687573] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=26] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:19.687640] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=51] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=19) [2025-04-21 14:08:19.690945] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=23] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:19.691000] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:19.691023] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=19) [2025-04-21 14:08:19.695247] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695315] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695475] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695657] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695704] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695739] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695759] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=48] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695819] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.695863] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.696068] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.696304] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:19.704707] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215699586888000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=117796, in_cluster_service=true, cluster_version={val:1745215699410724000, v:0}, min_cluster_version={val:1745215699410724000, v:0}, max_cluster_version={val:1745215699410724000, v:0}, get_cluster_version_err=0, cluster_version_delta=293960, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=781, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=34525277, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:19.725662] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.765727] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=47, avg_log_submit_to_flush_time=2288, avg_log_submit_to_slide_time=2309) [2025-04-21 14:08:19.765760] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=89] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2160, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:19.765817] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:19.765889] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:19.784881] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:19.794596] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:19.809909] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:19.809963] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:19.814639] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=55] ====== tenant freeze timer task ====== [2025-04-21 14:08:19.817866] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE12-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:19.817895] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:19.817939] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE12-0-0] [lt=69] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:19.819000] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:19.819051] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:19.819068] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:19.819095] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:19.819119] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254904369228, flush_io_finished_ret_:0, flush_io_finished_round_:91, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:19.825736] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=94][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.826034] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=86] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:19.833436] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:19.846114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:19.860672] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:19.860721] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.867854] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=28] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65640560}, readable_log_tail:{lsn:65640560}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1464208, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:19.868008] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=152] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:19.868055] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=22] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:19.871704] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:19.871755] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=47] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:19.871783] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=25] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:19.871807] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:19.875099] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:19.875830] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=727] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:19.878381] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=30] Garbage Collector is running(seq_=10, gc_interval=10000000) [2025-04-21 14:08:19.878471] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=48] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:19.878509] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=28] gc_check_member_list_ cost time(ret=0, time_us=78) [2025-04-21 14:08:19.878538] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:08:19.878564] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:19.878593] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=25] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:19.878617] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=26) [2025-04-21 14:08:19.878637] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyHandler start process [2025-04-21 14:08:19.886361] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:19.886420] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1925, avg_log_submit_to_slide_time=1949) [2025-04-21 14:08:19.888687] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=58] finish to resize log external storage handler(current_ts=1745215699888680, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:19.925807] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:19.929934] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14195, max_lsn:65641266, max_scn:{val:1745215699910817000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65641266}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65640682}, last_submit_end_lsn:{lsn:65641266}, last_submit_log_id:14195, last_submit_log_pid:3, max_flushed_lsn:{lsn:65640682}, max_flushed_end_lsn:{lsn:65641266}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65641266}, last_slide_log_id:14195, last_slide_scn:{val:1745215699910817000, v:0}, last_slide_lsn:{lsn:65640682}, last_slide_end_lsn:{lsn:65641266}, last_slide_log_pid:3, last_slide_log_accum_checksum:2591008926, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14196, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65641266}, readable_log_tail:{lsn:65641266}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1463502, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:19.930217] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=275] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215699912645, last_flushed_end_lsn:{lsn:65641266}}]) [2025-04-21 14:08:19.930244] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14196, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215699912645, last_flushed_end_lsn:{lsn:65641266}}]) [2025-04-21 14:08:19.931332] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:19.933279] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0018-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:19.933321] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=73] get number(ret=0, service_type_=0, range=1, base_id=1745215699933282000, start_id=1745215699933282000, end_id=1745215699933282001) [2025-04-21 14:08:19.935879] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0018-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254905486187, cache_obj->added_lc()=false, cache_obj->get_object_id()=630, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:19.939292] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:19.939369] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:19.951988] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=63] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:19.952774] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=45] current monitor number(seq_=-1) [2025-04-21 14:08:19.961824] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:19.961908] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:19.961941] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:19.961966] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:19.961988] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:19.963768] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:19.963792] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:08:19.963849] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:19.963836] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2063, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:19.963874] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2141, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:19.963881] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:19.963904] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=2093, avg_log_submit_to_slide_time=2109) [2025-04-21 14:08:19.963957] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:19.963979] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2220, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:19.964001] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:19.964042] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:19.997229] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=113] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8375) [2025-04-21 14:08:19.997379] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=15, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:20.006781] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF1A-0-0] [lt=119] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082313966751098633e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.585196955847193294e+02) [2025-04-21 14:08:20.025856] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.029992] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=42] LogLoopThread round_cost_time(us)(round_cost_time=382) [2025-04-21 14:08:20.030934] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=82] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:20.033560] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:20.046668] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:20.051203] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=63] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:08:20.060011] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:20.060085] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.065718] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:20.125925] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.161183] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=81] ts response task statistics(alloc_count=1950, free_count=974) [2025-04-21 14:08:20.183666] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD5-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:20.183719] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD5-0-0] [lt=51] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:20.197361] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:20.197422] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8375, avg_group_log_size=492) [2025-04-21 14:08:20.208418] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:20.212274] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8964) [2025-04-21 14:08:20.212372] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8964) [2025-04-21 14:08:20.212432] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1519, avg_log_submit_to_slide_time=1535) [2025-04-21 14:08:20.212482] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8964, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:20.226005] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.233721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:20.237056] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:20.237121] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:20.237303] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:20.237502] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:20.237592] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:15, schedule:34, submit:7, rt:1185, total:1242) [2025-04-21 14:08:20.237677] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:20.237758] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:15, schedule:34, submit:7, device:1185, total:1242) [2025-04-21 14:08:20.237826] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:20.237898] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:813, total:829) [2025-04-21 14:08:20.237969] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:20.238003] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:813, total:829) [2025-04-21 14:08:20.238057] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:20.238080] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:20.238747] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE09-0-0] [lt=27] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:20.238804] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE09-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:20.247207] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:20.247489] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash time detail, (compute_wash_size_time=158, refresh_score_time=44, wash_time=0) [2025-04-21 14:08:20.261506] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=42][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:20.262050] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:20.262101] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:20.285135] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:20.285193] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:20.286697] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=91] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1758, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:20.286788] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:20.286833] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:20.286874] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1942, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:20.286899] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:20.312802] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4079) [2025-04-21 14:08:20.313081] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4079, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:20.318892] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:20.326081] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.360858] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:20.360942] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.362155] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:20.399296] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1440, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:20.399364] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:20.399448] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:20.399505] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1573, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:20.400013] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:08:20.400060] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:20.409180] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=77] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215700206442000, v:0}, new_max_version={val:1745215700206442000, v:0}, last_min_version={val:1745215700006276000, v:0}, last_max_version={val:1745215700006276000, v:0}, total_time_us=3871, delta_us=202732) [2025-04-21 14:08:20.409256] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=74] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215700206442000, v:0}, min_version={val:1745215700206442000, v:0}, max_version={val:1745215700206442000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:20.410846] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=104] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:20.417906] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:08:20.423325] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=38] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:20.423442] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=106] temporary file module use no blocks [2025-04-21 14:08:20.423468] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:20.423510] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=37] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:20.423554] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254904973597, flush_io_finished_ret_:0, flush_io_finished_round_:92, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:20.423687] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215700423681, bytes: 4221083, bw: 0.012089 MB/s, add_ts: 1007568, add_bytes: 12772 [2025-04-21 14:08:20.426162] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.426270] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=97] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:20.438956] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4600000, replace_num=100000) [2025-04-21 14:08:20.439009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:20.439537] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:20.439626] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.448027] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:20.461648] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=74] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:20.463941] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:08:20.470004] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50] ====== tenant freeze timer task ====== [2025-04-21 14:08:20.475212] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.475282] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.475326] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.476199] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.482966] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1745215700482961, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2025-04-21 14:08:20.511678] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=118] get number(ret=0, service_type_=0, range=1, base_id=1745215700511018000, start_id=1745215700511018000, end_id=1745215700511018001) [2025-04-21 14:08:20.526228] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.527586] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=51] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:20.542039] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF001A-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:20.544464] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF001A-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254906094771, cache_obj->added_lc()=false, cache_obj->get_object_id()=631, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:20.545837] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF001E-0-0] [lt=45][errcode=-4201] hashtable not init [2025-04-21 14:08:20.545872] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF001E-0-0] [lt=34] get cursor info failed(cursor_id=31, get_sessid()=3221487630) [2025-04-21 14:08:20.546021] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215700545767000, start_id=1745215700545767000, end_id=1745215700545767001) [2025-04-21 14:08:20.560236] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:20.560306] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.564351] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=35] ====== check clog disk timer task ====== [2025-04-21 14:08:20.564401] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=42] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:20.569331] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=75] gc stale ls task succ [2025-04-21 14:08:20.587721] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:20.590972] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3971, offset=47637}, end_cursor:ObLogCursor{file_id=3, log_id=3972, offset=47943}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787d4050, len:1515, log_data_len:306, seq:3971, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:20.591365] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3A-0-0] [lt=26] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:20.591439] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3A-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215700160496003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215700160496003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:20.597454] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=68] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3972, offset=47943}, end_cursor:ObLogCursor{file_id=3, log_id=3973, offset=48240}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787d8050, len:1209, log_data_len:297, seq:3972, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:20.597760] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3A-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:20.597813] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3A-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215700160496003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215700160496003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:20.601096] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:20.601141] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:20.602800] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:20.602837] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:20.608206] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:20.626305] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.628786] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:20.630742] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:20.630872] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=52] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215698732525000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:20.639116] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:20.648634] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=102] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:20.661757] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=74] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:20.661849] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=70] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215700661828], gts:1745215700661038000, latest_srr:[mts=1745215700661828]}) [2025-04-21 14:08:20.664043] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17307335, this={dio_aligned_buf:{buf_write_offset:1857, buf_padding_size:2239, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2097, truncate_used_ts:766}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17305600, buf_len=122, total_write_size=13963, total_write_size_after_dio=430080, ob_pwrite_used_ts=180420, count=102, each_pwrite_cost=1768) [2025-04-21 14:08:20.671956] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] ====== tenant freeze timer task ====== [2025-04-21 14:08:20.672014] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=47] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:20.672058] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:20.695568] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695609] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=76] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695653] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695701] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695719] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695773] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695813] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695877] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.695941] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.696151] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.696418] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=53] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:20.712036] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=5223, avg_group_log_size=401) [2025-04-21 14:08:20.712093] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4760) [2025-04-21 14:08:20.724587] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=70] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:20.726392] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.764004] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:08:20.785016] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:20.817990] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:20.819277] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:20.819336] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:08:20.819355] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:20.819395] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=37] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:20.819417] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254905369481, flush_io_finished_ret_:0, flush_io_finished_round_:92, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:20.819440] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE13-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:20.819507] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE13-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:20.826186] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:20.826475] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.839261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:20.849194] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:20.861056] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:20.861110] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.864381] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1741, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:20.864394] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1919, avg_log_submit_to_slide_time=1935) [2025-04-21 14:08:20.864478] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:20.864528] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:20.886980] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=23] [APPLY STAT CB APPEND COST TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=60, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:20.887045] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=64] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1756, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:20.887069] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=22] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:20.887098] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=28] [APPLY STAT CB EXECUTE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=-502, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:20.887126] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF001F-0-0] [lt=26] [APPLY STAT CB TOTAL TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1314, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:20.912311] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=69] LogLoopThread round_cost_time(us)(round_cost_time=22) [2025-04-21 14:08:20.913875] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5223) [2025-04-21 14:08:20.913928] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1665, avg_log_submit_to_slide_time=1686) [2025-04-21 14:08:20.922711] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=39] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:20.926562] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:20.939886] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0020-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:20.939880] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:20.939944] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:20.942262] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0020-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254906492570, cache_obj->added_lc()=false, cache_obj->get_object_id()=632, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:20.952935] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=34] current monitor number(seq_=-1) [2025-04-21 14:08:20.962547] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:20.962639] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:20.962672] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:20.962723] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:20.962747] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:20.964186] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:20.964233] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:20.964275] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1818, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:20.964327] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:20.964357] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1876, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:20.964357] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:20.964375] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1844, avg_log_submit_to_slide_time=1866) [2025-04-21 14:08:20.964444] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:20.964475] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1965, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:20.964497] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:20.964553] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:20.997941] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8261) [2025-04-21 14:08:21.001581] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:21.001634] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=51] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:21.001643] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAC-0-0] [lt=18] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:21.001703] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAC-0-0] [lt=54] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:21.007421] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF1F-0-0] [lt=48] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:21.011740] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215701011197000, start_id=1745215701011197000, end_id=1745215701011197001) [2025-04-21 14:08:21.026629] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.026950] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=19] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:21.027089] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=48] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:21.031075] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=44] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:21.037884] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=26] === Run print tenant memory usage task === [2025-04-21 14:08:21.037962] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=37] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 134,103,040 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 776,400,896 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,701,037,705 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,070,678,016 max_mem_memstore_can_get_now= 2,465,120,256 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,701,037,705 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,563,500 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 543,141,888 max_mem_memstore_can_get_now= 362,817,516 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,701,037,705 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,944,860 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 641,425,408 max_mem_memstore_can_get_now= 314,724,314 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:08:21.038060] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,180,355,584 total_hold= 3,351,248,896 used= 3,096,264,704 freelists_hold= 84,090,880 total_maps= 1,203 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,865,956,352 divisive_memory_used= 134,103,040 virtual_memory_used= 4,554,702,848 [CHUNK_MGR] 2 MB_CACHE: hold= 35,651,584 free= 17 pushes= 306,471 pops= 306,454 maps= 1,069 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 89 pops= 87 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:08:21.038109] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:08:21.039397] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:21.049744] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:21.050289] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1745215691047561, end_time=1745215701050285, dag_status={}) [2025-04-21 14:08:21.050352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=58] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050388] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050382] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE0A-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.050410] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050424] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050443] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050464] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050484] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050504] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:21.050543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050571] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050653] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050673] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050767] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050828] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050851] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050871] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050885] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050905] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.050985] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051004] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051043] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051062] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051139] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051160] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051180] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051200] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051219] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051238] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051277] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051297] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051318] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051337] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051397] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051437] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051457] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051500] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051519] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051575] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051589] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051611] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051625] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051664] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051692] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051713] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051728] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051807] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051862] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051882] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051902] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:21.051923] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:21.051944] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:21.051962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:21.051974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:21.051993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:21.052005] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:21.052017] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:21.052028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:21.052040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:21.052051] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:21.052069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:21.053544] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD8E-0-0] [lt=48] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:08:21.054472] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=36] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745300471149799, last_date_:0, this_date_:0, next_date_:1745300471149799, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:21.054590] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=115] check all tenants(ret=0) [2025-04-21 14:08:21.055981] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE0E-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.057314] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE0F-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.058611] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE10-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.060411] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:21.060463] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.062244] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE11-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.063576] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE12-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.064980] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE13-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.066458] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE14-0-0] [lt=56] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.088912] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:21.088986] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=68] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:21.089051] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=61] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:21.089088] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=34] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:21.093041] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=28] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:21.093411] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=364] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:21.098016] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:21.099681] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD98-0-0] [lt=51] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=93) [2025-04-21 14:08:21.099912] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1745215701099482000, start_id=1745215701099482000, end_id=1745215701099482001) [2025-04-21 14:08:21.105152] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] success to update min reserved snapshot(reserved_snapshot=1745213891147050000, duration=1800, snapshot_gc_ts=1745215691147050000) [2025-04-21 14:08:21.106937] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=50] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213891147050000) [2025-04-21 14:08:21.108284] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8720634, this={dio_aligned_buf:{buf_write_offset:362, buf_padding_size:3734, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2441, truncate_used_ts:1037}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8720384, buf_len=112, total_write_size=13538, total_write_size_after_dio=430080, ob_pwrite_used_ts=172266, count=101, each_pwrite_cost=1705) [2025-04-21 14:08:21.108350] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1332) [2025-04-21 14:08:21.108546] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=46] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1745213891147050000) [2025-04-21 14:08:21.108584] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=36] update reserved snapshot finished(cost_ts=3438, reserved_snapshot=1745213891147050000) [2025-04-21 14:08:21.126707] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.129624] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:21.141170] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=37] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:08:21.142521] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=50] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:08:21.142567] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=42] no transfer partition job [2025-04-21 14:08:21.142603] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=30] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:08:21.145297] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=27] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:08:21.145357] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=46] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:08:21.145401] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8E-0-0] [lt=37] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:08:21.162390] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215701162356], gts:1745215701161477000, latest_srr:[mts=1745215701162356]}) [2025-04-21 14:08:21.185525] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD6-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:21.185578] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD6-0-0] [lt=51] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:21.206276] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=43][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:21.207752] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:21.207818] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=9243, avg_group_log_size=543) [2025-04-21 14:08:21.209410] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:21.209974] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215700662129003, v:0}, base_version={val:1745215700662129001, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215700662129003, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215701209949, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:21.212898] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8653) [2025-04-21 14:08:21.212968] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1394, avg_log_submit_to_slide_time=1411) [2025-04-21 14:08:21.213056] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8653, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:21.226783] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.236414] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB1-0-0] [lt=50] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:21.236484] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB1-0-0] [lt=61] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=73) [2025-04-21 14:08:21.239197] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:21.239262] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:21.239440] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:21.239523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:21.239625] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:21.239718] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:16, schedule:38, submit:9, rt:1201, total:1264) [2025-04-21 14:08:21.239796] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:21.239870] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:16, schedule:38, submit:9, device:1201, total:1264) [2025-04-21 14:08:21.239926] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:21.240000] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:667, total:683) [2025-04-21 14:08:21.240082] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:21.240121] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:667, total:683) [2025-04-21 14:08:21.240180] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:21.240206] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:21.240534] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE15-0-0] [lt=35] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:21.240598] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE15-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.250267] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:21.259495] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=10000000, clean_num=200000) [2025-04-21 14:08:21.262796] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=2571, avg_group_log_size=214) [2025-04-21 14:08:21.262864] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:21.285849] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:21.285908] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:21.287169] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=85] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1417, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:21.287231] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:21.287268] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:21.287301] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1568, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:21.287323] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:21.314251] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4094) [2025-04-21 14:08:21.314397] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4094, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:21.326850] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.361248] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:21.361341] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=81] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.362898] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2571) [2025-04-21 14:08:21.389301] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=18] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:08:21.389390] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=80] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:08:21.389423] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=30] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:08:21.389460] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=35] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:21.392183] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=37] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:08:21.393852] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=41] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:08:21.395334] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=38] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:08:21.395374] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:08:21.396683] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=21] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:08:21.396788] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=39] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:21.396819] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=28] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:21.399702] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1289, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:21.399766] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8775) [2025-04-21 14:08:21.399809] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:21.399869] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:21.399914] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1415, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:21.401221] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=24] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:08:21.402714] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=32] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:08:21.402753] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:08:21.404067] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=19] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:21.404181] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:21.404207] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=23] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:21.407643] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] submit log success(service_type_=0, last_id=1745215717945792000, limited_id=1745215717945792000) [2025-04-21 14:08:21.407681] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] submit log with lock success(service_type_=0, last_id=1745215717945792000, limited_id=1745215717945792000) [2025-04-21 14:08:21.408590] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=22] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:08:21.408985] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] update id meta(ret=0, service_type=0, limited_id=1745215717945792000, latest_scn={val:1745215701407093001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:21.409090] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=104] handle submit callback(service_type_=0, success=true, used_ts=1449, log_ts={val:1745215701407093001, v:0}, limited_id=1745215717945792000) [2025-04-21 14:08:21.409113] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:21.409134] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:21.409603] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1745215701409253000, start_id=1745215701409253000, end_id=1745215701409253001) [2025-04-21 14:08:21.409729] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215701207359000, v:0}, new_max_version={val:1745215701207359000, v:0}, last_min_version={val:1745215701006854000, v:0}, last_max_version={val:1745215701006854000, v:0}, total_time_us=3642, delta_us=202366) [2025-04-21 14:08:21.409775] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215701207359000, v:0}, min_version={val:1745215701207359000, v:0}, max_version={val:1745215701207359000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:21.410122] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=39] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:08:21.410154] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=31] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:08:21.411520] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=19] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:21.411622] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=34] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:21.411646] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=23] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:21.411693] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:21.411679] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=21] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:21.411742] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=56] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:08:21.411764] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=20] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:21.411796] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:08:21.411827] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=30] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:08:21.411849] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:08:21.411865] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=15] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:21.411959] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=91] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:21.411984] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=24] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:08:21.412005] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:08:21.412021] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:21.412047] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:21.412069] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:08:21.413302] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=16] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:21.413343] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=38] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:21.413359] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=14] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:21.413408] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=17] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:08:21.413434] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=26] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:08:21.413454] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=18] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:08:21.413476] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=18] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:08:21.413502] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD90-0-0] [lt=25] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:08:21.417978] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:21.423696] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=59] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:21.423745] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:21.423761] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:21.423787] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:21.423810] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254905973931, flush_io_finished_ret_:0, flush_io_finished_round_:93, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:21.426418] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:21.426928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.431314] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1745215701431310, bytes: 4235306, bw: 0.013461 MB/s, add_ts: 1007629, add_bytes: 14223 [2025-04-21 14:08:21.439667] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:21.440063] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:21.440119] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.460118] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:21.464972] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2571) [2025-04-21 14:08:21.475097] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.475188] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.475234] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.475304] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.490570] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215701490564, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2025-04-21 14:08:21.500000] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB4-0-0] [lt=47] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:21.526999] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.540961] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0022-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:21.543532] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0022-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254907093840, cache_obj->added_lc()=false, cache_obj->get_object_id()=633, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:21.560623] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:21.560705] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.569407] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:21.574475] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=58] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:21.574533] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:21.574557] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:21.574584] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:21.574609] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254906124688, flush_io_finished_ret_:0, flush_io_finished_round_:93, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:21.587884] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:21.589565] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:21.589684] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:08:21.600824] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:21.600868] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:21.602173] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:21.602211] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:21.604201] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3973, offset=48240}, end_cursor:ObLogCursor{file_id=3, log_id=3974, offset=48546}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787dc050, len:912, log_data_len:306, seq:3973, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:21.604540] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3B-0-0] [lt=25] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:21.604611] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3B-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215701162546002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215701162546002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:21.611176] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=88] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3974, offset=48546}, end_cursor:ObLogCursor{file_id=3, log_id=3975, offset=48843}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787e0050, len:606, log_data_len:297, seq:3974, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:21.611489] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3B-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:21.611553] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3B-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215701162546003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215701162546003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:21.620746] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF64-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:21.624616] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1745215701623638000, start_id=1745215701623638000, end_id=1745215701623638001) [2025-04-21 14:08:21.626761] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF68-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:21.627070] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.639803] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:21.660665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:21.662907] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:21.695252] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=59] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695321] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695368] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695385] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695614] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695701] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695814] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695869] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.695968] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.696029] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.696230] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:21.716153] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDD1-0-0] [lt=52] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:21.727200] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:21.727236] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=34] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:21.727259] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.779046] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDD3-0-0] [lt=39] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:21.785144] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=54] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:21.797694] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=40] XA scheduler heartbeat task statistics(avg_time=4) [2025-04-21 14:08:21.803699] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=128] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:21.807069] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=21] ====== traversal_flush timer task ====== [2025-04-21 14:08:21.807174] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD99-0-0] [lt=40] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:21.807312] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD99-0-0] [lt=130] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:21.809731] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8A-0-0] [lt=40] MediumCheckTask(cost_ts=9) [2025-04-21 14:08:21.810093] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:21.810139] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:21.810440] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:21.816300] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=66] ====== tenant freeze timer task ====== [2025-04-21 14:08:21.818062] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:21.819565] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:21.819617] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:21.819639] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:21.819664] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:21.819687] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254906369779, flush_io_finished_ret_:0, flush_io_finished_round_:93, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:21.820932] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE14-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:21.820993] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE14-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:21.826339] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:21.827209] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.831884] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:21.832843] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:21.832898] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=53] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:21.832963] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:21.833076] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=108] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:21.833119] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:21.833146] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215698658513001, v:0}) [2025-04-21 14:08:21.833165] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:21.833182] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:21.833205] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:21.833236] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:21.833257] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:21.833287] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:21.833320] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:21.833341] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:21.838898] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=53] clear dtl interm result cost(us)(clear_cost=3073, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:21.839946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:21.861443] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:21.861499] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.861598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:21.865058] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1491, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:21.865176] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2571) [2025-04-21 14:08:21.865264] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1742, avg_log_submit_to_slide_time=1757) [2025-04-21 14:08:21.865338] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:21.865389] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:21.880755] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:21.880883] WDIAG read_multi_row (ob_table_access_helper.h:238) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=44][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:21.882458] INFO delete_row (ob_table_access_helper.h:312) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=48] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215701880933) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215701880933) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:21.886307] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3657, avg_group_log_size=332) [2025-04-21 14:08:21.886354] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4120) [2025-04-21 14:08:21.896639] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=46] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:21.906066] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDD5-0-0] [lt=225] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:21.906702] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC0-0-0] [lt=44] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:21.912440] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=50] ls blacklist refresh finish(cost_time=8572) [2025-04-21 14:08:21.914174] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:21.914231] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1573, avg_log_submit_to_slide_time=1591) [2025-04-21 14:08:21.927281] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:21.940279] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:21.940360] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:21.946129] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0024-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:21.948493] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0024-0-0] [lt=44][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254907498801, cache_obj->added_lc()=false, cache_obj->get_object_id()=634, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:21.963354] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:21.963445] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:21.963478] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1832, avg_group_log_size=183) [2025-04-21 14:08:21.963523] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1832) [2025-04-21 14:08:21.963553] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:21.964950] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=100] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1636, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:21.965039] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:21.965034] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=92] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:21.965106] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:21.965150] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1775, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:21.965177] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:21.965210] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1832) [2025-04-21 14:08:21.965243] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:21.965262] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1659, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:21.965282] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1625, avg_log_submit_to_slide_time=1643) [2025-04-21 14:08:21.965366] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1832, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:21.979107] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=75] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:08:21.998659] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8905) [2025-04-21 14:08:22.008129] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF24-0-0] [lt=48] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:22.027349] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.028109] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=54] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:22.031204] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:22.040101] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:22.047241] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=33] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:22.047345] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=62] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:22.047380] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=143, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:22.047453] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:22.047523] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:22.047545] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=9, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:22.060831] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:22.060882] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.062086] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:22.086390] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:22.086436] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] try gc retain ctx [2025-04-21 14:08:22.086452] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:22.086501] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] finish update min start scn(max_decided_scn={val:1745215701912141000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215691901613001, v:0}, keep_alive_scn_:{val:1745215696907950001, v:0}, update_ts_:1745215702086030}) [2025-04-21 14:08:22.087460] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:22.106978] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215702008230000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215702106908}, version_delta=98745) [2025-04-21 14:08:22.111164] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215701912141000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199015, in_cluster_service=true, cluster_version={val:1745215701711363000, v:0}, min_cluster_version={val:1745215701711363000, v:0}, max_cluster_version={val:1745215701711363000, v:0}, get_cluster_version_err=0, cluster_version_delta=399793, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=832, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=39641293, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:22.127412] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.163509] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=46] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=395, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:22.165463] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:08:22.187471] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD7-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:22.187531] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD7-0-0] [lt=56] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:22.208813] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:22.208880] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8510, avg_group_log_size=472) [2025-04-21 14:08:22.210177] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:22.214026] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8511) [2025-04-21 14:08:22.214081] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=138, avg_log_gen_to_submit_time=155, avg_log_submit_to_flush_time=1562, avg_log_submit_to_slide_time=1580) [2025-04-21 14:08:22.214204] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8511, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:22.227484] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.240227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:22.241097] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=11kB/s, net_out=11kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:22.241188] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:22.241375] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:22.241570] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:22.241656] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:21, schedule:46, submit:9, rt:1836, total:1913) [2025-04-21 14:08:22.241739] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:22.241808] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:21, schedule:46, submit:9, device:1836, total:1913) [2025-04-21 14:08:22.241872] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:22.241947] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:739, total:754) [2025-04-21 14:08:22.242026] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:22.242064] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:739, total:754) [2025-04-21 14:08:22.242133] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:22.242162] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:22.242985] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE17-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:22.243069] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE17-0-0] [lt=80] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:22.262603] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:22.263580] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:22.263632] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:22.279419] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=22] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:22.280633] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=49] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:22.280730] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215701156150000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:22.286601] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=104] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:22.286700] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:22.288157] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1495, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:22.288218] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:22.288273] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:22.288314] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1642, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:22.288348] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:22.314896] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:08:22.315148] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:22.327552] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.337661] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=82] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:22.361628] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:22.361707] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.363664] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:22.400205] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:08:22.400299] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=80] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:22.400521] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1487, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:22.400571] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8511) [2025-04-21 14:08:22.400607] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:22.400677] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:22.400723] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1738, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:22.410620] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215702208336000, v:0}, new_max_version={val:1745215702208336000, v:0}, last_min_version={val:1745215702008230000, v:0}, last_max_version={val:1745215702008230000, v:0}, total_time_us=3454, delta_us=202280) [2025-04-21 14:08:22.410671] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215702208336000, v:0}, min_version={val:1745215702208336000, v:0}, max_version={val:1745215702208336000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:22.412633] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:22.418064] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:08:22.426580] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:22.427623] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.438910] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215702438905, bytes: 4247514, bw: 0.011555 MB/s, add_ts: 1007595, add_bytes: 12208 [2025-04-21 14:08:22.440354] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:22.440535] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:22.440593] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.463188] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:22.465478] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:22.470546] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=105] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:22.471490] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=55] ====== tenant freeze timer task ====== [2025-04-21 14:08:22.475143] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=63] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.475213] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.475400] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.476043] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.498177] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1745215702498171, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007607, add_bytes: 0 [2025-04-21 14:08:22.510431] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=55] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:22.511672] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=55] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:22.511778] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215695543275000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:22.511826] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=44] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215695543275000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1745215695543275000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:22.527716] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.560643] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=67] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:22.561062] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:22.561116] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.564553] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:22.564622] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=60] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:22.569490] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:22.588124] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:22.599004] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:22.599074] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=57] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=19) [2025-04-21 14:08:22.601433] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:22.601481] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:22.603290] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:22.603327] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:22.617420] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3975, offset=48843}, end_cursor:ObLogCursor{file_id=3, log_id=3976, offset=49149}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787e4050, len:4405, log_data_len:306, seq:3975, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:22.617784] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:22.617853] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215702163149003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215702163149003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:22.621168] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=21] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=1, MAX_GAP=900000000000, new_sync_scn={val:1745215701162546004, v:0}, new_replayable_scn={val:1745215701162546004, v:0}, new_readable_scn={val:1745215701162546003, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215700160496004, replayable_scn:1745215700160496004, readable_scn:1745215700160496003, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:08:22.621481] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1745215702621331000, start_id=1745215702621331000, end_id=1745215702621331001) [2025-04-21 14:08:22.624284] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=67] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3976, offset=49149}, end_cursor:ObLogCursor{file_id=3, log_id=3977, offset=49446}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787e8050, len:4099, log_data_len:297, seq:3976, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:22.624548] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:22.624612] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3C-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215702163149003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215702163149003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:22.627800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=80][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.645498] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4700000, replace_num=100000) [2025-04-21 14:08:22.645545] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:22.663728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:22.664220] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=62] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:22.664494] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=72] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215702664476], gts:1745215702664245000, latest_srr:[mts=1745215702664476]}) [2025-04-21 14:08:22.664541] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25861327}, readable_log_tail:{lsn:25861327}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41243441, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:22.664728] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=185] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:08:22.664796] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=35] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:22.665782] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=15] [APPLY STAT CB APPEND COST TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=31, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:22.665832] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=49] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1756, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:22.665849] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:22.665864] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=-534, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:22.665885] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1254, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:22.673440] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:08:22.673494] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=44] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:22.673533] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:22.676977] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] [COMPACTION DAG STATUS] (start_time=1745215692674268, end_time=1745215702676974, dag_status={}) [2025-04-21 14:08:22.677034] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=52] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677061] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677081] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677100] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677118] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677137] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677173] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677190] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:22.677208] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677272] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677366] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677423] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677441] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677508] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677544] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677563] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677581] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677634] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677670] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677695] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677806] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677840] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677858] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677876] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677893] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677911] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677925] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677943] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677981] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.677999] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678017] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678090] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678107] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678126] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678143] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678204] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678222] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678240] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678436] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678454] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678472] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:22.678492] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:22.678511] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:22.678529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:22.678541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:22.678558] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:22.678574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:22.678591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:22.678607] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:22.678623] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:22.678639] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:22.678657] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:22.687445] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=56] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585097048064, fast_delete_log_mode=false) [2025-04-21 14:08:22.693790] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=10, gc_interval=10000000) [2025-04-21 14:08:22.693891] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=53] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:22.693934] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=30] gc_check_member_list_ cost time(ret=0, time_us=88) [2025-04-21 14:08:22.693962] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:22.695434] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.695720] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=48] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.695744] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:22.695769] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.695785] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=32] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:22.695812] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=24] execute_gc cost time(ret=0, time_us=30) [2025-04-21 14:08:22.695828] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2025-04-21 14:08:22.695844] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:08:22.695874] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:08:22.695872] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.695910] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696057] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696132] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696306] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696300] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696359] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.696401] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:22.727878] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.759625] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15543, max_lsn:25861327, max_scn:{val:1745215702625624000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:25861327}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:25860578}, last_submit_end_lsn:{lsn:25861327}, last_submit_log_id:15543, last_submit_log_pid:3, max_flushed_lsn:{lsn:25860578}, max_flushed_end_lsn:{lsn:25861327}, max_flushed_log_pid:3, committed_end_lsn:{lsn:25861327}, last_slide_log_id:15543, last_slide_scn:{val:1745215702625624000, v:0}, last_slide_lsn:{lsn:25860578}, last_slide_end_lsn:{lsn:25861327}, last_slide_log_pid:3, last_slide_log_accum_checksum:1066860918, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15544, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:25861327}, readable_log_tail:{lsn:25861327}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41243441, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:08:22.759952] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=318] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215702627838, last_flushed_end_lsn:{lsn:25861327}}]) [2025-04-21 14:08:22.759979] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15544, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215702627838, last_flushed_end_lsn:{lsn:25861327}}]) [2025-04-21 14:08:22.781433] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=58] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:22.785282] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:22.818152] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:22.819504] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=51] BlockGCTimerTask success(ret=0, cost_time_us=17, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:22.819826] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:22.819899] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=64] temporary file module use no blocks [2025-04-21 14:08:22.819925] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:22.819955] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:22.819981] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254907370046, flush_io_finished_ret_:0, flush_io_finished_round_:94, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:22.822931] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE15-0-0] [lt=44] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:22.823009] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE15-0-0] [lt=74] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:22.826500] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:22.827965] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.845660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:22.853498] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0026-0-0] [lt=39] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215702853471}) [2025-04-21 14:08:22.853554] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=65] new mysql sessid created(conn.sessid_=3221487761, support_ssl=false) [2025-04-21 14:08:22.853562] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD2-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.853710] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=38] sm conn init succ(conn.sessid_=3221487761, sess.client_addr_="127.0.0.1:36752") [2025-04-21 14:08:22.853739] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487761, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:190}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.853786] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] new mysql sessid created(conn.sessid_=3221487762, support_ssl=false) [2025-04-21 14:08:22.853824] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=13] sm conn init succ(conn.sessid_=3221487762, sess.client_addr_="127.0.0.1:36766") [2025-04-21 14:08:22.853842] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487762, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:192}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.853870] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] new mysql sessid created(conn.sessid_=3221487763, support_ssl=false) [2025-04-21 14:08:22.853903] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11] sm conn init succ(conn.sessid_=3221487763, sess.client_addr_="127.0.0.1:36782") [2025-04-21 14:08:22.853919] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=13] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487763, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.853946] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] new mysql sessid created(conn.sessid_=3221487764, support_ssl=false) [2025-04-21 14:08:22.853978] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=12] sm conn init succ(conn.sessid_=3221487764, sess.client_addr_="127.0.0.1:36788") [2025-04-21 14:08:22.854004] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=13] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487764, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854047] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=44] new mysql sessid created(conn.sessid_=3221487765, support_ssl=false) [2025-04-21 14:08:22.854094] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD2-0-0] [lt=61] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702854063, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.854127] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=33] sm conn init succ(conn.sessid_=3221487765, sess.client_addr_="127.0.0.1:36776") [2025-04-21 14:08:22.854149] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD2-0-0] [lt=53] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215702853471}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702854063, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.854157] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487765, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854197] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221487766, support_ssl=false) [2025-04-21 14:08:22.854246] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=24] sm conn init succ(conn.sessid_=3221487766, sess.client_addr_="127.0.0.1:36800") [2025-04-21 14:08:22.854270] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3c20ef6030, session_id:3221487766, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854305] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] new mysql sessid created(conn.sessid_=3221487767, support_ssl=false) [2025-04-21 14:08:22.854343] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487767, sess.client_addr_="127.0.0.1:36804") [2025-04-21 14:08:22.854365] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c20ef6d70, session_id:3221487767, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854399] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487768, support_ssl=false) [2025-04-21 14:08:22.854436] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487768, sess.client_addr_="127.0.0.1:36818") [2025-04-21 14:08:22.854441] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=60] new mysql sessid created(conn.sessid_=3221487769, support_ssl=false) [2025-04-21 14:08:22.854458] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20ef8030, session_id:3221487768, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854522] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=36] sm conn init succ(conn.sessid_=3221487769, sess.client_addr_="127.0.0.1:36822") [2025-04-21 14:08:22.854550] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3c20ef8d70, session_id:3221487769, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854594] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=64] new mysql sessid created(conn.sessid_=3221487770, support_ssl=false) [2025-04-21 14:08:22.854662] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] new mysql sessid created(conn.sessid_=3221487771, support_ssl=false) [2025-04-21 14:08:22.854680] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=38] sm conn init succ(conn.sessid_=3221487770, sess.client_addr_="127.0.0.1:36826") [2025-04-21 14:08:22.854728] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=42] accept one succ(*s={this:0x7f3c20efa030, session_id:3221487770, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854742] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487771, sess.client_addr_="127.0.0.1:36840") [2025-04-21 14:08:22.854783] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=35] accept one succ(*s={this:0x7f3c20efad70, session_id:3221487771, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854820] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221487772, support_ssl=false) [2025-04-21 14:08:22.854878] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221487772, sess.client_addr_="127.0.0.1:36850") [2025-04-21 14:08:22.854903] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3c20efc030, session_id:3221487772, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.854992] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487773, support_ssl=false) [2025-04-21 14:08:22.855051] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221487773, sess.client_addr_="127.0.0.1:36858") [2025-04-21 14:08:22.855076] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3c20efcd70, session_id:3221487773, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.855079] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855126] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855128] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855149] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=21] mysql login queue(mysql_queue->queue_.size()=0) [2025-04-21 14:08:22.855166] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855181] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855207] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855218] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=24] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855232] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855285] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDA8-0-0] [lt=54] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.855321] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=46] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855318] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA3-0-0] [lt=38] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.855318] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA7-0-0] [lt=41] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.855362] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=27] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855384] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855410] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855460] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855486] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855517] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855539] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855568] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855603] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=30] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855638] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855662] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855757] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.855783] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.855693] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.856092] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=392] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.856129] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:22.856153] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:22.856314] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA3-0-0] [lt=32] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487773, proxy_sessid=0, client_sessid=3221487773, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.856313] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA7-0-0] [lt=33] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487772, proxy_sessid=0, client_sessid=3221487772, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.856385] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDA8-0-0] [lt=31] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487761, proxy_sessid=0, client_sessid=3221487761, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.856442] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA4-0-0] [lt=51] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.856442] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA8-0-0] [lt=45] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.856522] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDA9-0-0] [lt=46] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.856709] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0027-0-0] [lt=54] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215702856692}) [2025-04-21 14:08:22.856749] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0027-0-0] [lt=29] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215702856747}) [2025-04-21 14:08:22.856811] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAD-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215702856801}) [2025-04-21 14:08:22.856959] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD3-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702856926, sql_renew_time:1745215702856926, is_mark_fail:false}]) [2025-04-21 14:08:22.857048] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD3-0-0] [lt=87] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215702856692}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702856926, sql_renew_time:1745215702856926, is_mark_fail:false}]) [2025-04-21 14:08:22.857116] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD4-0-0] [lt=43] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702857103, sql_renew_time:1745215702857103, is_mark_fail:false}]) [2025-04-21 14:08:22.857156] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD4-0-0] [lt=38] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215702856747}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702857103, sql_renew_time:1745215702857103, is_mark_fail:false}]) [2025-04-21 14:08:22.857207] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD5-0-0] [lt=36] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.857226] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA4-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487771, proxy_sessid=0, client_sessid=3221487771, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.857256] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA8-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487770, proxy_sessid=0, client_sessid=3221487770, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.857338] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA5-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.857375] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA9-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.857364] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDA9-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487769, proxy_sessid=0, client_sessid=3221487769, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.857480] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAA-0-0] [lt=36] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.858090] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA5-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487768, proxy_sessid=0, client_sessid=3221487768, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.858134] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDA9-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487767, proxy_sessid=0, client_sessid=3221487767, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.858166] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8E-0-0] [lt=845] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215702858155}) [2025-04-21 14:08:22.858204] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA6-0-0] [lt=43] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.858236] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAA-0-0] [lt=33] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.858257] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAA-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487766, proxy_sessid=0, client_sessid=3221487766, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.858381] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAB-0-0] [lt=44] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.858408] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20efa030, session_id:3221487770, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.858481] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=61] kill and revert session(conn.sessid_=3221487770, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.858509] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] sock ref clean, do destroy(*s={this:0x7f3c20efa030, session_id:3221487770, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.858546] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] unlock session of tenant(conn.sessid_=3221487770, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.858574] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=25] connection close(sessid=3221487770, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.858639] INFO [SERVER] run (obmp_disconnect.cpp:82) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] free session successfully(sessid=3221487770) [2025-04-21 14:08:22.858666] INFO [SERVER] run (obmp_disconnect.cpp:89) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25] mark session id unused(sessid=3221487770) [2025-04-21 14:08:22.858786] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD5-0-0] [lt=32] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702858769, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.858843] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD5-0-0] [lt=55] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215702856801}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702858769, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.858899] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD6-0-0] [lt=40] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.858991] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA6-0-0] [lt=28] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487764, proxy_sessid=0, client_sessid=3221487764, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.859063] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAA-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487765, proxy_sessid=0, client_sessid=3221487765, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.859104] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA7-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:22.859096] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD88-0-0] [lt=45] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:22.859135] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9D-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215702859123}) [2025-04-21 14:08:22.859154] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8D-0-0] [lt=12] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215702859149}) [2025-04-21 14:08:22.859151] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD8E-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215702859145}) [2025-04-21 14:08:22.859181] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620062][T1_L0_G0][T1001][YB420B1D7AB6-00063343B87EFD88-0-0] [lt=33] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:22.859213] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620062][T1_L0_G0][T1002][YB420B1D7AB6-00063343B87EFD88-0-0] [lt=17] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:22.859246] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAB-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487763, proxy_sessid=0, client_sessid=3221487763, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.859366] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD6-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702859350, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.859408] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD6-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215702858155}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702859350, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.859455] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD7-0-0] [lt=32] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.859709] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=423) [2025-04-21 14:08:22.859772] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20ef6d70, session_id:3221487767, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.859820] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487767, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.859845] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD7-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702859830, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.859865] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f3c20ef6d70, session_id:3221487767, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.859868] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA7-0-0] [lt=18] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487762, proxy_sessid=0, client_sessid=3221487762, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:22.859898] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487767, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.859883] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD7-0-0] [lt=37] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215702859123}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702859830, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.859927] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD8-0-0] [lt=30] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.859915] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487767, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFD9D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.860074] INFO [SERVER] run (obmp_disconnect.cpp:82) [620053][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487767) [2025-04-21 14:08:22.860121] INFO [SERVER] run (obmp_disconnect.cpp:89) [620053][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=46] mark session id unused(sessid=3221487767) [2025-04-21 14:08:22.860221] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9E-0-0] [lt=33][errcode=0] server close connection(sessid=3221487761, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:22.860256] INFO [SERVER] process (obmp_quit.h:56) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9E-0-0] [lt=33] quit [2025-04-21 14:08:22.860288] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487761, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:190}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:0x7f3bc9822110, sz:0}, need_epoll_trigger_write:false, consume_size:241, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.860327] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] kill and revert session(conn.sessid_=3221487761, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.860354] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] can close safely, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487761, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:190}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:0x7f3bc9822110, sz:0}, need_epoll_trigger_write:false, consume_size:241, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:22.860393] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] unlock session of tenant(conn.sessid_=3221487761, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.860361] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8B-0-0] [lt=25] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215702860355}) [2025-04-21 14:08:22.860410] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487761, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDAD-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:24, seq_:30}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:31}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:22.860512] INFO [SERVER] run (obmp_disconnect.cpp:82) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=43] free session successfully(sessid=3221487761) [2025-04-21 14:08:22.860550] INFO [SERVER] run (obmp_disconnect.cpp:89) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487761) [2025-04-21 14:08:22.860641] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=46][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487765, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.860641] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAF-0-0] [lt=50] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215702860635}) [2025-04-21 14:08:22.860688] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=38] kill and revert session(conn.sessid_=3221487765, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.860710] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] sock ref clean, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487765, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.860705] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAF-0-0] [lt=45] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215702860703}) [2025-04-21 14:08:22.860724] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9F-0-0] [lt=15][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215702860718}) [2025-04-21 14:08:22.860744] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] unlock session of tenant(conn.sessid_=3221487765, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.860748] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAF-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215702860746}) [2025-04-21 14:08:22.860758] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9F-0-0] [lt=33][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215702860718}) [2025-04-21 14:08:22.860763] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487765, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDAE-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.860790] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAF-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215702860787}) [2025-04-21 14:08:22.860778] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFD9F-0-0] [lt=19][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215687867097, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.860817] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487765) [2025-04-21 14:08:22.860829] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDAF-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215702860826}) [2025-04-21 14:08:22.860857] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487765) [2025-04-21 14:08:22.860938] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20efc030, session_id:3221487772, trace_id:YB420B1D7AB6-00063343B4AF0028-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.860978] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=21][errcode=0] server close connection(sessid=3221487772, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:22.861029] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=48] quit [2025-04-21 14:08:22.861036] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=86] kill and revert session(conn.sessid_=3221487772, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.861045] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:22.861069] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=22][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:22.861090] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=20][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:22.861110] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=19][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:22.861136] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=23][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.861157] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0028-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.861176] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.861817] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:22.861872] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.862464] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20efad70, session_id:3221487771, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.862528] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=54] kill and revert session(conn.sessid_=3221487771, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.862546] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f3c20efad70, session_id:3221487771, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.862587] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] unlock session of tenant(conn.sessid_=3221487771, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.862610] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] connection close(sessid=3221487771, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD93-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.862662] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25] free session successfully(sessid=3221487771) [2025-04-21 14:08:22.862708] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=45] mark session id unused(sessid=3221487771) [2025-04-21 14:08:22.863179] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=40][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20efcd70, session_id:3221487773, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.863233] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=48] kill and revert session(conn.sessid_=3221487773, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.863251] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f3c20efcd70, session_id:3221487773, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.863235] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD8-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702863198, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.863278] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] unlock session of tenant(conn.sessid_=3221487773, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.863285] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD8-0-0] [lt=48] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215702859145}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702863198, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.863298] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487773, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B87EFD88-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.863330] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD9-0-0] [lt=27] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.863377] INFO [SERVER] run (obmp_disconnect.cpp:82) [620071][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=45] free session successfully(sessid=3221487773) [2025-04-21 14:08:22.863431] INFO [SERVER] run (obmp_disconnect.cpp:89) [620071][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=52] mark session id unused(sessid=3221487773) [2025-04-21 14:08:22.863728] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=50][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20ef6030, session_id:3221487766, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.863776] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=42] kill and revert session(conn.sessid_=3221487766, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.863796] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] sock ref clean, do destroy(*s={this:0x7f3c20ef6030, session_id:3221487766, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.863829] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487766, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.863848] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487766, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B70EFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.863885] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487766) [2025-04-21 14:08:22.863907] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487766) [2025-04-21 14:08:22.864034] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD9-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702864017, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.864077] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDD9-0-0] [lt=42] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215702859149}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702864017, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.864111] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDA-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:22.864292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43615698944, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:22.864359] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD8E-0-0] [lt=50][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:22.864791] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=46][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20ef8030, session_id:3221487768, trace_id:YB420B1D7AB6-00063343B4AF002A-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215702864442, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.864806] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=17][errcode=0] server close connection(sessid=3221487768, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:22.864835] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=26] quit [2025-04-21 14:08:22.864836] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] kill and revert session(conn.sessid_=3221487768, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.864850] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=14][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:22.864871] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=21][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:22.864890] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:22.864909] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:22.864931] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.864914] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=52][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487764, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.864950] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002A-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.864961] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487764, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.864968] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.864985] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] sock ref clean, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487764, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.865043] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=47] unlock session of tenant(conn.sessid_=3221487764, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.865098] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487764) [2025-04-21 14:08:22.865072] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] connection close(sessid=3221487764, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFD9F-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.865121] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487764) [2025-04-21 14:08:22.865923] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1648, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:22.865936] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:22.865975] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8B-0-0] [lt=49][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:22.866003] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1818, avg_log_submit_to_slide_time=1833) [2025-04-21 14:08:22.866079] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:22.866133] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDA-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866118, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.866162] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:22.866180] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDA-0-0] [lt=45] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215702860355}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866118, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:22.866241] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDB-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866229, sql_renew_time:1745215702866229, is_mark_fail:false}]) [2025-04-21 14:08:22.866270] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDB-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215702860635}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866229, sql_renew_time:1745215702866229, is_mark_fail:false}]) [2025-04-21 14:08:22.866311] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDC-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866300, sql_renew_time:1745215702866300, is_mark_fail:false}]) [2025-04-21 14:08:22.866335] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDC-0-0] [lt=24] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215702860703}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866300, sql_renew_time:1745215702866300, is_mark_fail:false}]) [2025-04-21 14:08:22.866374] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDD-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866364, sql_renew_time:1745215702866364, is_mark_fail:false}]) [2025-04-21 14:08:22.866409] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDD-0-0] [lt=33] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215702860746}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866364, sql_renew_time:1745215702866364, is_mark_fail:false}]) [2025-04-21 14:08:22.866449] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDE-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866438, sql_renew_time:1745215702866438, is_mark_fail:false}]) [2025-04-21 14:08:22.866476] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDE-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215702860787}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866438, sql_renew_time:1745215702866438, is_mark_fail:false}]) [2025-04-21 14:08:22.866517] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDF-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866506, sql_renew_time:1745215702866506, is_mark_fail:false}]) [2025-04-21 14:08:22.866550] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDDF-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215702860826}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702866506, sql_renew_time:1745215702866506, is_mark_fail:false}]) [2025-04-21 14:08:22.866960] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8E-0-0] [lt=36][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:22.866994] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487762, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.867041] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487762, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.867061] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] sock ref clean, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487762, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.867099] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487762, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.867120] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487762, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD8B-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.867156] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] free session successfully(sessid=3221487762) [2025-04-21 14:08:22.867179] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487762) [2025-04-21 14:08:22.867270] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] can close safely, do destroy(*s={this:0x7f3c20efc030, session_id:3221487772, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:22.867343] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=56] unlock session of tenant(conn.sessid_=3221487772, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.867393] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487772) [2025-04-21 14:08:22.867369] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487772, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF0027-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:22.867413] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] mark session id unused(sessid=3221487772) [2025-04-21 14:08:22.867437] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=60][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20ef8d70, session_id:3221487769, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.867475] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221487769, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.867565] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] sock ref clean, do destroy(*s={this:0x7f3c20ef8d70, session_id:3221487769, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215702857232, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.867605] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] unlock session of tenant(conn.sessid_=3221487769, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.867653] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487769) [2025-04-21 14:08:22.867625] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487769, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:22.867674] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=20] mark session id unused(sessid=3221487769) [2025-04-21 14:08:22.887094] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3526, avg_group_log_size=352) [2025-04-21 14:08:22.887152] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3526) [2025-04-21 14:08:22.912907] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=63] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:22.915119] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:08:22.915202] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1642, avg_log_submit_to_slide_time=1665) [2025-04-21 14:08:22.923555] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=43][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487763, trace_id:YB420B1D7AB6-00063343B4AF002B-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215702923346, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:22.923594] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=16][errcode=0] server close connection(sessid=3221487763, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:22.923648] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=81] kill and revert session(conn.sessid_=3221487763, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:22.923657] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=59] quit [2025-04-21 14:08:22.923678] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=17][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:22.923696] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=17][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:22.923709] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=12][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:22.923723] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=13][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:22.923751] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=24][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.923774] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002B-0-0] [lt=21][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.923792] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:22.928034] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:22.940721] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:22.940776] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:22.950245] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=14] can close safely, do destroy(*s={this:0x7f3c20ef8030, session_id:3221487768, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:221}, err:5, last_decode_time:1745215702864442, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:22.950324] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=62] unlock session of tenant(conn.sessid_=3221487768, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:22.950353] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] connection close(sessid=3221487768, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B64EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:22.950432] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=27] free session successfully(sessid=3221487768) [2025-04-21 14:08:22.950468] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=35] mark session id unused(sessid=3221487768) [2025-04-21 14:08:22.952531] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002C-0-0] [lt=12][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:22.953235] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=65] current monitor number(seq_=-1) [2025-04-21 14:08:22.954995] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002C-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254908505303, cache_obj->added_lc()=false, cache_obj->get_object_id()=635, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:22.964128] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:22.964236] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:22.964272] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:22.964305] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:22.964333] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:22.965932] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:22.965979] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:22.965987] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1706, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:22.966032] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=78, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:22.966045] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:22.966075] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1802, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:22.966100] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1766, avg_log_submit_to_slide_time=1790) [2025-04-21 14:08:22.966155] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:22.966175] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1896, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:22.966196] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:22.966276] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:22.999416] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=88] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8380) [2025-04-21 14:08:23.002424] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=36] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:23.002469] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=45] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:23.002476] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAD-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:23.002539] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAD-0-0] [lt=58] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:23.009330] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF29-0-0] [lt=34] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:23.011386] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:23.028131] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.031350] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:23.045819] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:23.061290] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:23.061361] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.064874] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:23.128217] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.142291] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:23.164877] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=39] ts response task statistics(alloc_count=2022, free_count=1010) [2025-04-21 14:08:23.166200] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:23.189426] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD8-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:23.189490] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD8-0-0] [lt=61] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:23.209748] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:23.209818] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8382, avg_group_log_size=493) [2025-04-21 14:08:23.211323] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:23.214957] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=66] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8382) [2025-04-21 14:08:23.215025] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1453, avg_log_submit_to_slide_time=1473) [2025-04-21 14:08:23.215068] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8382, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:23.228301] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.237113] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB2-0-0] [lt=48] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:23.237181] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB2-0-0] [lt=59] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=72) [2025-04-21 14:08:23.243241] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=17kB/s, net_out=17kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:23.243307] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:23.243494] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:23.243695] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:23.243782] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:8192, iops:2, bw:16349, [delay/us]:prepare:18, schedule:35, submit:8, rt:1211, total:1272) [2025-04-21 14:08:23.243877] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:23.243944] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:8192, avg_iops:2, avg_bw:16349, [delay/us]: prepare:18, schedule:35, submit:8, device:1211, total:1272) [2025-04-21 14:08:23.244007] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:23.244079] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:867, total:885) [2025-04-21 14:08:23.244158] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:23.244196] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:867, total:885) [2025-04-21 14:08:23.244261] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:23.244297] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:23.244856] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE18-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:23.244917] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE18-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:23.245965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:23.264356] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:23.264418] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:23.265471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:23.274648] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=10200000, clean_num=200000) [2025-04-21 14:08:23.287443] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:23.287534] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:23.288991] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=69] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1596, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:23.289080] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=79] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:23.289142] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:23.289187] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1765, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:23.289224] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:23.315623] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:08:23.315818] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:23.328372] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.362006] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:23.362100] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=85] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.364464] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:23.401311] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1369, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:23.401379] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=66] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8382) [2025-04-21 14:08:23.401419] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:23.401493] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:23.401533] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1505, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:23.409955] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1745215703409638000, start_id=1745215703409638000, end_id=1745215703409638001) [2025-04-21 14:08:23.411635] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215703209646000, v:0}, new_max_version={val:1745215703209646000, v:0}, last_min_version={val:1745215703009094000, v:0}, last_max_version={val:1745215703009094000, v:0}, total_time_us=3638, delta_us=201985) [2025-04-21 14:08:23.411683] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215703209646000, v:0}, min_version={val:1745215703209646000, v:0}, max_version={val:1745215703209646000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:23.413808] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:23.418167] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:23.424029] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:23.424091] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:08:23.424109] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:23.424139] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:23.424166] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254907974251, flush_io_finished_ret_:0, flush_io_finished_round_:95, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:23.426769] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:23.428438] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.440920] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:23.440976] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.446107] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:23.446520] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215703446514, bytes: 4265188, bw: 0.016728 MB/s, add_ts: 1007609, add_bytes: 17674 [2025-04-21 14:08:23.466346] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:23.474884] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.474959] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.475142] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:23.475454] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.475921] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.505783] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB5-0-0] [lt=29] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:23.505793] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215703505785, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2025-04-21 14:08:23.528524] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.561444] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:08:23.561529] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:23.561619] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=81] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.561623] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD98-0-0] [lt=66] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215703164629002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215700160496004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:23.561861] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD98-0-0] [lt=186] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215700160496004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:23.561994] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD98-0-0] [lt=129] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:23.566362] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=73, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:23.566407] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=44] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=2081, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:23.566423] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:23.566442] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=-564, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:23.566461] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=18] [APPLY STAT CB TOTAL TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=1590, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:23.569577] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:08:23.574824] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:23.574877] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:23.574895] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:23.574917] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:23.574937] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254908125062, flush_io_finished_ret_:0, flush_io_finished_round_:95, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:23.588322] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=68] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:23.601558] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:23.601622] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:23.603681] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:23.603741] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:23.628339] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:23.628602] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.629429] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=57] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:23.629499] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=69] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:23.629571] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215700160496004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:23.629679] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=102] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:23.629708] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:23.629730] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1745215694153093001, v:0}) [2025-04-21 14:08:23.629745] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:23.629764] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:23.629791] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:23.629814] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:23.629847] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:23.629883] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:23.630639] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3977, offset=49446}, end_cursor:ObLogCursor{file_id=3, log_id=3978, offset=49752}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787ec050, len:3802, log_data_len:306, seq:3977, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:23.630887] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:23.630928] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:23.630977] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215700160496004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:23.631061] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=81] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:23.631079] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:23.631051] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3D-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:23.631097] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:23.631117] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:23.631133] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:23.631151] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:23.631134] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3D-0-0] [lt=58] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215703164629003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215703164629003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:23.631173] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:23.631186] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:23.636120] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=58] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:23.637418] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=47] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:23.637514] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215698732525000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:23.637563] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215698732525000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1745215698732525000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:23.638282] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=67] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3978, offset=49752}, end_cursor:ObLogCursor{file_id=3, log_id=3979, offset=50049}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787f0050, len:3496, log_data_len:297, seq:3978, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:23.638581] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3D-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:23.638657] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3D-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215703164629003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215703164629003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:23.646252] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:23.658816] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=46] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:23.665415] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1745215703664829000, start_id=1745215703664829000, end_id=1745215703664829001) [2025-04-21 14:08:23.665537] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=90] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:23.665619] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215703665592], gts:1745215703664829000, latest_srr:[mts=1745215703665592]}) [2025-04-21 14:08:23.675680] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:23.695185] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695760] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695804] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695820] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695876] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695913] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.695973] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.696377] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.696385] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.696447] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.696493] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:23.708200] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=37][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:23.728631] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.761905] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9A-0-0] [lt=90] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:23.764684] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:23.764739] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] try gc retain ctx [2025-04-21 14:08:23.764755] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:23.764812] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215703164629004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215693652605001, v:0}, keep_alive_scn_:{val:1745215698658513001, v:0}, update_ts_:1745215703764318}) [2025-04-21 14:08:23.765800] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215701162546004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215710473222000, latest_log_ts:{val:1745215694153093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:23.765991] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=105] finish update min start scn(max_decided_scn={val:1745215703164629004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215693652605001, v:0}, keep_alive_scn_:{val:1745215698658513001, v:0}, update_ts_:1745215703765380}) [2025-04-21 14:08:23.766980] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215701162546004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:23.785421] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:23.810294] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:23.810388] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=81] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:23.815539] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=81] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:23.817911] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:08:23.818232] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:23.820118] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:23.820174] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:23.820206] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=29] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:23.820234] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:23.820260] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254908370343, flush_io_finished_ret_:0, flush_io_finished_round_:95, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:23.825616] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE16-0-0] [lt=20] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:23.825703] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE16-0-0] [lt=82] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:23.826701] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:23.828707] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.846390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:23.862207] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:23.862264] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.866558] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=78] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1622, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:23.866717] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:23.866791] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:23.866828] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1860, avg_log_submit_to_slide_time=1875) [2025-04-21 14:08:23.866888] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:23.876247] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43626184704, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:23.881434] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=33] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:23.883339] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215703882900000, start_id=1745215703882900000, end_id=1745215703882900001) [2025-04-21 14:08:23.887925] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:23.887988] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:08:23.912257] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215703164629004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=747616, in_cluster_service=true, cluster_version={val:1745215703164629003, v:0}, min_cluster_version={val:1745215703164629003, v:0}, max_cluster_version={val:1745215703164629003, v:0}, get_cluster_version_err=0, cluster_version_delta=747616, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=824, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=34787981, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:23.916799] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:08:23.916870] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=37, avg_log_submit_to_flush_time=1677, avg_log_submit_to_slide_time=1704) [2025-04-21 14:08:23.922853] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=41] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:23.924712] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] can close safely, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487763, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:205}, err:5, last_decode_time:1745215702923346, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:229, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:23.924802] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=66] unlock session of tenant(conn.sessid_=3221487763, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:23.924837] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] connection close(sessid=3221487763, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDAF-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:23.924894] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] free session successfully(sessid=3221487763) [2025-04-21 14:08:23.924939] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=42] mark session id unused(sessid=3221487763) [2025-04-21 14:08:23.928800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:23.941135] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:23.941192] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:23.953377] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=43] current monitor number(seq_=-1) [2025-04-21 14:08:23.958311] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002E-0-0] [lt=19][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:23.960765] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF002E-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254909511070, cache_obj->added_lc()=false, cache_obj->get_object_id()=636, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:23.964883] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:23.965096] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=173] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:23.965131] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:23.965164] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:23.965195] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:23.966843] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:23.966898] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:23.966955] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:23.966988] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1765, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:23.966952] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1749, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:23.967003] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1735, avg_log_submit_to_slide_time=1755) [2025-04-21 14:08:23.967016] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:23.967054] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:23.967076] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1923, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:23.967099] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:23.967139] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:24.001750] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=33] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=52, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:24.001823] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=72] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1606, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:24.001845] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:24.001858] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-486, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:24.001871] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1172, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:24.010106] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF2E-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:24.010439] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9052) [2025-04-21 14:08:24.012134] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get_max_applied_scn(scn={val:1745215703882900000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25872268}, palf_committed_end_scn_:{val:1745215704009840000, v:0}, last_check_scn_:{val:1745215704009840000, v:0}, max_applied_cb_scn_:{val:1745215703882900000, v:0}}) [2025-04-21 14:08:24.012195] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25872268}, readable_log_tail:{lsn:25872268}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41232500, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:24.012724] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=64] get_max_applied_scn(scn={val:1745215703914937000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65656500}, palf_committed_end_scn_:{val:1745215703914937000, v:0}, last_check_scn_:{val:1745215703914937000, v:0}, max_applied_cb_scn_:{val:1745215703914937000, v:0}}) [2025-04-21 14:08:24.012791] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65656500}, readable_log_tail:{lsn:65656500}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1448268, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:24.028872] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.031519] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=66] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:24.044382] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:24.044434] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=47] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:24.044455] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=20] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:24.044480] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:24.046539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:24.047654] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:24.048009] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=352] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:24.061755] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:24.061810] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.076764] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:24.099559] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=58][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65656500}], scn_array=[cnt:1, {val:1745215703914937001, v:0}], curr_size=122, accum_size=2243, time_cost=11553) [2025-04-21 14:08:24.119057] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=123] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:24.128957] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.166129] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215704166094], gts:1745215704165731000, latest_srr:[mts=1745215704166094]}) [2025-04-21 14:08:24.166396] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=63] submit log success(service_type_=0, last_id=1745215720473222000, limited_id=1745215720473222000) [2025-04-21 14:08:24.166429] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=32] submit log with lock success(service_type_=0, last_id=1745215720473222000, limited_id=1745215720473222000) [2025-04-21 14:08:24.166461] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=396, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:24.166846] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:24.167645] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215720473222000, latest_scn={val:1745215704165731001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215701162546004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:24.167745] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=98] handle submit callback(service_type_=0, success=true, used_ts=1349, log_ts={val:1745215704165731001, v:0}, limited_id=1745215720473222000) [2025-04-21 14:08:24.167775] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=29] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:24.167799] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF67-0-0] [lt=22] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:24.191336] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD9-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:24.191396] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDD9-0-0] [lt=57] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:24.210431] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:24.210484] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8930, avg_group_log_size=496) [2025-04-21 14:08:24.211852] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:24.212001] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:24.215175] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8930) [2025-04-21 14:08:24.215379] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=78] get_max_applied_scn(scn={val:1745215703664829003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17308979}, palf_committed_end_scn_:{val:1745215704165731001, v:0}, last_check_scn_:{val:1745215704165731001, v:0}, max_applied_cb_scn_:{val:1745215703664829003, v:0}}) [2025-04-21 14:08:24.215436] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17308979}, readable_log_tail:{lsn:17308979}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49795789, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:24.229028] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.245209] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:24.245266] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:24.245439] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:24.245627] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:24.245713] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:24, schedule:33, submit:11, rt:1395, total:1465) [2025-04-21 14:08:24.245790] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:24.245852] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:24, schedule:33, submit:11, device:1395, total:1465) [2025-04-21 14:08:24.245912] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:24.245983] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:926, total:941) [2025-04-21 14:08:24.246060] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:24.246100] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:926, total:941) [2025-04-21 14:08:24.246156] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:24.246181] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:24.246668] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE19-0-0] [lt=21] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:24.246701] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:24.246753] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE19-0-0] [lt=81] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:24.256808] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=51] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:24.273597] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=47] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:24.277297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:24.288109] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:24.288182] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:24.289552] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2487, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:24.289610] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:24.289685] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:24.289715] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2644, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:24.289750] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:24.312592] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=103] get_max_applied_scn(scn={val:1745215703664829004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8721045}, palf_committed_end_scn_:{val:1745215704165731000, v:0}, last_check_scn_:{val:1745215704165731000, v:0}, max_applied_cb_scn_:{val:1745215703664829004, v:0}}) [2025-04-21 14:08:24.312649] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=52] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8721045}, readable_log_tail:{lsn:8721045}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58383723, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:24.329100] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.354889] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:24.362378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:24.362445] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.365214] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1339, avg_group_log_size=121) [2025-04-21 14:08:24.365269] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:08:24.365295] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:24.389786] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=43] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:24.397383] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=25] ====== traversal_flush timer task ====== [2025-04-21 14:08:24.397571] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD99-0-0] [lt=68] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215704213642000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:24.397775] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD99-0-0] [lt=194] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:24.398556] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=41] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:24.398621] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=50] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:24.398655] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=20) [2025-04-21 14:08:24.399990] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8A-0-0] [lt=49] MediumCheckTask(cost_ts=11) [2025-04-21 14:08:24.400443] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:24.400488] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=36] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:24.401932] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1323, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:24.401981] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8930) [2025-04-21 14:08:24.402013] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:24.402079] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:24.402117] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1452, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:24.402134] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=19, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1430, avg_log_submit_to_slide_time=1449) [2025-04-21 14:08:24.402187] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9052, hit_cnt=19, read_cnt=19, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:24.412361] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215704209381000, v:0}, new_max_version={val:1745215704209381000, v:0}, last_min_version={val:1745215704009840000, v:0}, last_max_version={val:1745215704009840000, v:0}, total_time_us=3537, delta_us=202976) [2025-04-21 14:08:24.412414] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215704209381000, v:0}, min_version={val:1745215704209381000, v:0}, max_version={val:1745215704209381000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:24.414166] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=105] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:24.418241] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=58] gc stale ls task succ [2025-04-21 14:08:24.426939] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:24.427187] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:24.428158] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:24.428217] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=58] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:24.428287] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:24.428379] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=87] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:24.428427] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:24.428454] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215701407093001, v:0}) [2025-04-21 14:08:24.428473] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:24.428491] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:24.428513] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:24.428543] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:24.428565] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:24.428595] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:24.428628] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:24.428648] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:24.429190] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.441388] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:24.441482] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=83] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.446830] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:24.446888] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] success to update min reserved snapshot(reserved_snapshot=1745213898732525000, duration=1800, snapshot_gc_ts=1745215698732525000) [2025-04-21 14:08:24.448930] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=55] update reserved snapshot finished(cost_ts=2048, reserved_snapshot=1745213898732525000) [2025-04-21 14:08:24.454140] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1745215704454136, bytes: 4277960, bw: 0.012088 MB/s, add_ts: 1007622, add_bytes: 12772 [2025-04-21 14:08:24.457438] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=65][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:24.457649] WDIAG read_multi_row (ob_table_access_helper.h:238) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=63][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:24.460048] INFO delete_row (ob_table_access_helper.h:312) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215704457695) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215704457695) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:24.466814] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:08:24.467703] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=71] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:24.473108] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=38] ====== tenant freeze timer task ====== [2025-04-21 14:08:24.475112] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=52] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.475112] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.475175] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.475221] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.477759] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:24.479457] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=71] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:24.489638] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3657) [2025-04-21 14:08:24.489770] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=83] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3657, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:24.513406] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215704513400, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2025-04-21 14:08:24.514735] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=117] get number(ret=0, service_type_=0, range=1, base_id=1745215704514314000, start_id=1745215704514314000, end_id=1745215704514314001) [2025-04-21 14:08:24.529259] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.551668] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0030-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:24.554064] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0030-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254910104372, cache_obj->added_lc()=false, cache_obj->get_object_id()=637, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:24.555405] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0033-0-0] [lt=42][errcode=-4201] hashtable not init [2025-04-21 14:08:24.555441] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0033-0-0] [lt=35] get cursor info failed(cursor_id=32, get_sessid()=3221487630) [2025-04-21 14:08:24.555601] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1745215704554777000, start_id=1745215704554777000, end_id=1745215704554777001) [2025-04-21 14:08:24.561970] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:24.562040] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.564786] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:08:24.564850] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=52] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:24.569653] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:24.575069] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:24.575142] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=63] temporary file module use no blocks [2025-04-21 14:08:24.575178] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=33] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:24.575221] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=39] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:24.575261] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=37] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254909125290, flush_io_finished_ret_:0, flush_io_finished_round_:96, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:24.588502] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:24.600539] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=71] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:24.600586] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=45] try gc retain ctx [2025-04-21 14:08:24.600601] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:24.600650] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215704414040001, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215694511261001, v:0}, keep_alive_scn_:{val:1745215699586888001, v:0}, update_ts_:1745215704599939}) [2025-04-21 14:08:24.601315] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=131][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:24.601361] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:24.601668] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:24.603344] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:24.603381] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:24.629330] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.645726] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3979, offset=50049}, end_cursor:ObLogCursor{file_id=3, log_id=3980, offset=50355}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787f4050, len:3199, log_data_len:306, seq:3979, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:24.646067] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3E-0-0] [lt=53] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:24.646162] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3E-0-0] [lt=64] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215704165731004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215704165731004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:24.647024] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:24.651872] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=32] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:24.651925] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=18) [2025-04-21 14:08:24.652595] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3980, offset=50355}, end_cursor:ObLogCursor{file_id=3, log_id=3981, offset=50652}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787f8050, len:2893, log_data_len:297, seq:3980, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:24.652736] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:24.652781] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:24.652809] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=25] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:24.652828] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=18) [2025-04-21 14:08:24.652875] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3E-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:24.652925] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3E-0-0] [lt=29] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215704165731003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215704165731003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:24.666729] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:24.666807] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=58] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=407, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:24.674983] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=15] ====== tenant freeze timer task ====== [2025-04-21 14:08:24.675053] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=59] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:24.675095] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:24.678286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:24.687763] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=25] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:24.687828] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=48] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=20) [2025-04-21 14:08:24.691148] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:24.691224] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=59] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:24.691269] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=39] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=20) [2025-04-21 14:08:24.694848] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=61] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.694911] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.694951] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.695568] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=75] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.695631] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.695853] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.695998] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.696062] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.696463] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.696522] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.696565] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:24.709080] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215704414040001, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=295023, in_cluster_service=true, cluster_version={val:1745215704414040000, v:0}, min_cluster_version={val:1745215704414040000, v:0}, max_cluster_version={val:1745215704414040000, v:0}, get_cluster_version_err=0, cluster_version_delta=295023, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=830, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=39529656, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:24.718315] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDD3-0-0] [lt=52] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:24.729498] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=92] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:24.729532] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:24.729550] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.781282] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDD5-0-0] [lt=37] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:24.785535] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:24.818314] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:24.820402] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:24.820470] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=58] temporary file module use no blocks [2025-04-21 14:08:24.820496] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:24.820524] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:24.820550] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254909370623, flush_io_finished_ret_:0, flush_io_finished_round_:96, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:24.826858] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:24.827622] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE17-0-0] [lt=26] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:24.827692] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE17-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:24.829466] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.852166] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4800000, replace_num=100000) [2025-04-21 14:08:24.852206] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:24.862570] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:24.862647] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.867368] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1226) [2025-04-21 14:08:24.867415] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1563, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:24.867445] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=65, avg_log_gen_to_submit_time=100, avg_log_submit_to_flush_time=1553, avg_log_submit_to_slide_time=1574) [2025-04-21 14:08:24.867508] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:24.867556] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1226, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:24.875988] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:24.876036] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:24.876064] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=25] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:24.876088] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=22] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:24.878889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:24.879417] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:24.880126] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=705] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:24.888561] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4094, avg_group_log_size=372) [2025-04-21 14:08:24.888608] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4094) [2025-04-21 14:08:24.907123] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC2-0-0] [lt=40] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:24.908600] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDD7-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:24.908688] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDD9-0-0] [lt=44] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:24.913269] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=49] start to print blacklist info [2025-04-21 14:08:24.913441] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=40] ls blacklist refresh finish(cost_time=9439) [2025-04-21 14:08:24.929536] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:24.935845] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:24.937773] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1745215704937292000, start_id=1745215704937292000, end_id=1745215704937292001) [2025-04-21 14:08:24.939544] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4639) [2025-04-21 14:08:24.939645] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=72] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=2418, avg_log_submit_to_slide_time=2443) [2025-04-21 14:08:24.941595] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:24.941676] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:24.955008] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=39] current monitor number(seq_=-1) [2025-04-21 14:08:24.956079] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=61] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:24.964966] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0035-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:24.965774] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:24.965920] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:24.965964] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:24.966000] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:24.966031] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:24.967624] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0035-0-0] [lt=32][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254910517931, cache_obj->added_lc()=false, cache_obj->get_object_id()=638, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:24.967650] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1454, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:24.967717] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:24.967716] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:24.967756] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:24.967808] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1656, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:24.967835] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:24.967866] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:24.967895] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:24.967916] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1696, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:24.967936] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1673, avg_log_submit_to_slide_time=1683) [2025-04-21 14:08:24.967987] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:25.003357] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=33] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:25.003413] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=55] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:25.003406] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAE-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:25.003450] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAE-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:25.011097] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=87] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8488) [2025-04-21 14:08:25.014924] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215705014094000, start_id=1745215705014094000, end_id=1745215705014094001) [2025-04-21 14:08:25.029622] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.031648] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=47] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:25.034026] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=43] LogLoopThread round_cost_time(us)(round_cost_time=18) [2025-04-21 14:08:25.047725] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:25.047841] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=65] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:25.047876] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=148, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:25.047962] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=36] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:25.048030] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=27] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:25.048053] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=9, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:25.052304] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:25.062156] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:25.062211] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.079418] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:25.129707] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.150703] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=89] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:25.167534] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:25.193262] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDA-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:25.193319] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDA-0-0] [lt=55] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:25.210520] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=41] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1, avail_memory=268435456, chunk_count_=0, avail_sort_memory_=268435456, avail_memory_=268435456) [2025-04-21 14:08:25.210593] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=41] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:08:25.210642] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=45] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:08:25.211679] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF34-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:25.211976] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:25.212027] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8487, avg_group_log_size=471) [2025-04-21 14:08:25.213357] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:25.216088] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8487) [2025-04-21 14:08:25.229788] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.237764] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB3-0-0] [lt=48] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:25.237818] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB3-0-0] [lt=45] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=56) [2025-04-21 14:08:25.247216] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:25.247275] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:25.247450] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:25.247628] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:25.247713] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:18, schedule:42, submit:11, rt:1485, total:1557) [2025-04-21 14:08:25.247790] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:25.247851] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:18, schedule:42, submit:11, device:1485, total:1557) [2025-04-21 14:08:25.247914] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:25.247990] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:759, total:775) [2025-04-21 14:08:25.248067] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:25.248104] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:759, total:775) [2025-04-21 14:08:25.248163] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:25.248190] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:25.248167] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1A-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:25.248225] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1A-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:25.252431] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:25.279948] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:25.286240] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:25.287500] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=53] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:25.287594] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215701156150000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:25.287637] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215701156150000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1745215701156150000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:25.288877] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:25.288940] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:25.289070] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=10400000, clean_num=200000) [2025-04-21 14:08:25.290434] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65665942, this={dio_aligned_buf:{buf_write_offset:3088, buf_padding_size:1008, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2867, truncate_used_ts:1139}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65662976, buf_len=122, total_write_size=39538, total_write_size_after_dio=479232, ob_pwrite_used_ts=190807, count=108, each_pwrite_cost=1766) [2025-04-21 14:08:25.290497] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1486, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:25.290527] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:25.290606] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:25.290638] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1618, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:25.290665] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:25.290962] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=26] success to update min reserved snapshot(reserved_snapshot=1745213895543275000, duration=1800, snapshot_gc_ts=1745215695543275000) [2025-04-21 14:08:25.292370] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213895543275000) [2025-04-21 14:08:25.292404] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] update reserved snapshot finished(cost_ts=1446, reserved_snapshot=1745213895543275000) [2025-04-21 14:08:25.315021] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619978][T1_TenantWeakRe][T1][YB420B1D7AB6-00063343B1EEFF46-0-0] [lt=47] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=update __all_weak_read_service set min_version=?, max_version=? where tenant_id = ? and level_id = ? and level_value = ? and min_version = ? and max_version = ?) [2025-04-21 14:08:25.329861] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.361735] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=68][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:25.362786] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:25.362847] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.366057] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:25.366117] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:25.366152] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:25.403173] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1374, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:25.403244] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8487) [2025-04-21 14:08:25.403285] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:25.403362] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:25.403403] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1502, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:25.403433] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1462, avg_log_submit_to_slide_time=1479) [2025-04-21 14:08:25.403499] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8487, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:25.414250] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215705211188000, v:0}, new_max_version={val:1745215705211188000, v:0}, last_min_version={val:1745215705010859000, v:0}, last_max_version={val:1745215705010859000, v:0}, total_time_us=3774, delta_us=203059) [2025-04-21 14:08:25.414298] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215705211188000, v:0}, min_version={val:1745215705211188000, v:0}, max_version={val:1745215705211188000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:25.414328] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:25.415645] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:25.418329] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:25.424399] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:25.424470] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=61] temporary file module use no blocks [2025-04-21 14:08:25.424499] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:25.424529] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:25.424557] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254909974617, flush_io_finished_ret_:0, flush_io_finished_round_:97, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:25.427101] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:25.429958] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.441773] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:25.441841] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.452565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:25.461761] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215705461755, bytes: 4292183, bw: 0.013462 MB/s, add_ts: 1007619, add_bytes: 14223 [2025-04-21 14:08:25.467713] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:25.474517] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.474589] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.475690] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.476136] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.489543] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:25.490442] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4751) [2025-04-21 14:08:25.490607] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4751, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:25.510589] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] get wrs ts(ls_id={id:1}, delta=98701, log_service_ts=1745215705411847, min_tx_service_ts=4611686018427387, timestamp={val:1745215705411847000, v:0}) [2025-04-21 14:08:25.510658] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=57, Other_Error_Cnt=0, Submit_Succ_Cnt=43, last_scn="{val:1745215704414040002, v:0}", last_lsn={lsn:25875625}, last_gts={val:1745215705415063000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:08:25.511840] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB6-0-0] [lt=38] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:25.517050] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=13] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:25.518348] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:25.518453] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215695543275000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:25.521037] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215705521032, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007632, add_bytes: 0 [2025-04-21 14:08:25.530044] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.550051] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=58] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:25.551763] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0037-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:25.554350] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0037-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254911104657, cache_obj->added_lc()=false, cache_obj->get_object_id()=639, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:25.562350] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:25.562405] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.569722] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:25.575413] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=63] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:25.575469] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:25.575495] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:25.575525] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:25.575551] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254910125642, flush_io_finished_ret_:0, flush_io_finished_round_:97, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:25.588673] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:25.601361] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:25.601408] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:25.603032] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:25.603068] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:25.630112] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.652715] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:25.659105] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3981, offset=50652}, end_cursor:ObLogCursor{file_id=3, log_id=3982, offset=50958}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c787fc050, len:2596, log_data_len:306, seq:3981, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:25.659414] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3F-0-0] [lt=26] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:25.659505] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3F-0-0] [lt=61] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215705167017003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215705167017003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:25.665411] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3982, offset=50958}, end_cursor:ObLogCursor{file_id=3, log_id=3983, offset=51255}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77404050, len:2290, log_data_len:297, seq:3982, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:25.665700] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3F-0-0] [lt=54] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:25.665765] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE3F-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215705167017003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215705167017003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:25.667736] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=41] handle gts request statistics(total_rt=618, total_cnt=60, avg_rt=1.013114754098360670e+01, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:08:25.667819] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=64] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:25.668123] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215705668106], gts:1745215705667440000, latest_srr:[mts=1745215705668106]}) [2025-04-21 14:08:25.690060] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:25.695009] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695078] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695127] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695580] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=52] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695729] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695781] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.695816] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.696066] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=66] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.696094] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.696147] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:25.707242] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=26] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17310687}, readable_log_tail:{lsn:17310687}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49794081, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:25.707377] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=133] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:08:25.707402] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=21] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8722753}, readable_log_tail:{lsn:8722753}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58382015, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:25.707457] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=55] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:08:25.707491] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=11] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:25.729047] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=59] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:25.730204] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.738204] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=19] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:08:25.738263] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=54] finish to resize log external storage handler(current_ts=1745215705738259, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:25.740430] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] Garbage Collector is running(seq_=10, gc_interval=10000000) [2025-04-21 14:08:25.740522] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=56] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:25.740554] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=29] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:25.740577] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=89) [2025-04-21 14:08:25.740604] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:25.742300] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:25.743560] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=42] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:25.743605] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:25.743628] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:25.743651] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=48) [2025-04-21 14:08:25.743667] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyHandler start process [2025-04-21 14:08:25.760053] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD99-0-0] [lt=27] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:08:25.760137] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD99-0-0] [lt=74] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:08:25.785690] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:25.810527] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:08:25.810578] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:25.816494] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:9938, max_lsn:17310809, max_scn:{val:1745215705667440000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17310809}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17310687}, last_submit_end_lsn:{lsn:17310809}, last_submit_log_id:9938, last_submit_log_pid:3, max_flushed_lsn:{lsn:17310687}, max_flushed_end_lsn:{lsn:17310809}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17310809}, last_slide_log_id:9938, last_slide_scn:{val:1745215705667440000, v:0}, last_slide_lsn:{lsn:17310687}, last_slide_end_lsn:{lsn:17310809}, last_slide_log_pid:3, last_slide_log_accum_checksum:1718590527, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:9939, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17310809}, readable_log_tail:{lsn:17310809}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49793959, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:08:25.816745] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=246] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215705768175, last_flushed_end_lsn:{lsn:17310809}}]) [2025-04-21 14:08:25.816771] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=9939, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215705768175, last_flushed_end_lsn:{lsn:17310809}}]) [2025-04-21 14:08:25.816812] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:13876, max_lsn:8722875, max_scn:{val:1745215705667440000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8722875}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8722753}, last_submit_end_lsn:{lsn:8722875}, last_submit_log_id:13876, last_submit_log_pid:3, max_flushed_lsn:{lsn:8722753}, max_flushed_end_lsn:{lsn:8722875}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8722875}, last_slide_log_id:13876, last_slide_scn:{val:1745215705667440000, v:0}, last_slide_lsn:{lsn:8722753}, last_slide_end_lsn:{lsn:8722875}, last_slide_log_pid:3, last_slide_log_accum_checksum:434679794, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:13877, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8722875}, readable_log_tail:{lsn:8722875}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58381893, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:08:25.816986] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=171] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215705768266, last_flushed_end_lsn:{lsn:8722875}}]) [2025-04-21 14:08:25.817024] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=36] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=13877, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215705768266, last_flushed_end_lsn:{lsn:8722875}}]) [2025-04-21 14:08:25.818383] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:25.819572] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:08:25.825166] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:25.827016] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:25.829896] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE18-0-0] [lt=27] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:25.829987] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE18-0-0] [lt=86] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:25.830274] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.852853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:25.862957] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:25.863013] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.868225] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:25.868277] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1524, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:25.868325] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=78] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1653, avg_log_submit_to_slide_time=1674) [2025-04-21 14:08:25.868397] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:25.868447] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:25.889421] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=5519, avg_group_log_size=394) [2025-04-21 14:08:25.889508] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=71] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5519) [2025-04-21 14:08:25.890633] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:25.891060] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=26] [APPLY STAT CB APPEND COST TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=59, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:25.891107] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=45] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1835, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:25.891123] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:25.891142] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=-570, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:25.891161] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1325, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:25.892440] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=57] BlockGCTimerTask success(ret=0, cost_time_us=19, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:25.916576] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=35] LogLoopThread round_cost_time(us)(round_cost_time=589) [2025-04-21 14:08:25.930354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:25.941986] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:25.942069] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:25.955159] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=47] current monitor number(seq_=-1) [2025-04-21 14:08:25.966555] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:25.966647] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:25.966681] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:25.966730] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:25.966760] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:25.968229] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:25.968255] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:25.968317] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:25.968304] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1544, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:25.968352] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1620, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:25.968357] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:25.968367] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1591, avg_log_submit_to_slide_time=1610) [2025-04-21 14:08:25.968416] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:25.968442] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1695, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:25.968459] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:25.968503] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:25.971097] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0038-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:25.973485] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0038-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254911523792, cache_obj->added_lc()=false, cache_obj->get_object_id()=640, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:26.012689] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8381) [2025-04-21 14:08:26.030434] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.031775] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:26.052997] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:26.062563] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:26.062636] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.090950] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5096) [2025-04-21 14:08:26.091021] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1435, avg_log_submit_to_slide_time=1454) [2025-04-21 14:08:26.091235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:26.093619] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:26.093696] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=71] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:26.093726] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=27] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:26.093753] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:26.096908] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:26.097217] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=305] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:26.101819] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=54] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:26.103510] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD99-0-0] [lt=49] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:08:26.103755] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1745215706102764000, start_id=1745215706102764000, end_id=1745215706102764001) [2025-04-21 14:08:26.130522] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.168390] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=34] ts response task statistics(alloc_count=2094, free_count=1046) [2025-04-21 14:08:26.168459] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:26.195187] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDB-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:26.195247] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDB-0-0] [lt=56] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:26.212682] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF39-0-0] [lt=46] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:26.212956] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:26.213022] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8381, avg_group_log_size=493) [2025-04-21 14:08:26.214317] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:26.216869] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8381) [2025-04-21 14:08:26.230599] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.249187] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:26.249284] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:26.249514] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:26.249739] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:26.249827] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:14, schedule:45, submit:9, rt:1200, total:1269) [2025-04-21 14:08:26.249902] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:26.249961] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:14, schedule:45, submit:9, device:1200, total:1269) [2025-04-21 14:08:26.250023] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:26.250098] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:588, total:606) [2025-04-21 14:08:26.250070] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1B-0-0] [lt=28] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:26.250143] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1B-0-0] [lt=70] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:26.250178] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:26.250214] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:588, total:606) [2025-04-21 14:08:26.250272] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:26.250308] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:26.253138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:26.289681] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:26.289734] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:26.291365] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1371, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:26.291415] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:26.291468] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:26.291495] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1489, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:26.291520] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:26.291730] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:26.306485] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=48][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:26.314490] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215706115602000, v:0}, base_version={val:1745215705915839000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215706115602000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215706314455, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:26.330680] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.363124] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:26.363191] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.366878] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2025-04-21 14:08:26.366947] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1522) [2025-04-21 14:08:26.366975] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:26.371268] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=63] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:26.400638] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:08:26.400708] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=56] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:26.403431] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1294, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:26.403484] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8381) [2025-04-21 14:08:26.403521] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:26.403597] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:26.403644] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1460, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:26.414471] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1417, avg_log_submit_to_slide_time=1433) [2025-04-21 14:08:26.414525] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8970, hit_cnt=19, read_cnt=19, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:26.414637] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215706211984000, v:0}, new_max_version={val:1745215706211984000, v:0}, last_min_version={val:1745215706011696000, v:0}, last_max_version={val:1745215706011696000, v:0}, total_time_us=3397, delta_us=202651) [2025-04-21 14:08:26.414676] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215706211984000, v:0}, min_version={val:1745215706211984000, v:0}, max_version={val:1745215706211984000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:26.415663] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:26.418411] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=74] gc stale ls task succ [2025-04-21 14:08:26.424702] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:26.424760] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:08:26.424778] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:26.424807] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:26.424833] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254910974920, flush_io_finished_ret_:0, flush_io_finished_round_:98, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:26.427259] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:26.430763] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.442222] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:26.442281] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.453282] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:26.468576] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1522) [2025-04-21 14:08:26.469370] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=70] PNIO [ratelimit] time: 1745215706469366, bytes: 4304955, bw: 0.012088 MB/s, add_ts: 1007611, add_bytes: 12772 [2025-04-21 14:08:26.474617] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.474695] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:08:26.475647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.475695] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.475777] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=52] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.488289] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=102] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:26.491466] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4862) [2025-04-21 14:08:26.491675] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4862, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:26.492223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:26.528661] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215706528649, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2025-04-21 14:08:26.530854] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.562825] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:26.562910] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.565030] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=38] ====== check clog disk timer task ====== [2025-04-21 14:08:26.565083] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:26.569788] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:26.588836] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:26.601536] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:26.601581] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:26.603399] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:26.603436] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:26.614481] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:26.630944] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.631701] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF6F-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:26.635276] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1745215706635039000, start_id=1745215706635039000, end_id=1745215706635039001) [2025-04-21 14:08:26.637851] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF73-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:26.642962] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:26.644213] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:26.644315] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215698732525000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:26.653449] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:26.668930] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=64] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:26.669022] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215706668982], gts:1745215706668150000, latest_srr:[mts=1745215706668982]}) [2025-04-21 14:08:26.669573] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1745215696667040, end_time=1745215706669570, dag_status={}) [2025-04-21 14:08:26.669624] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=46] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669654] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669675] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669695] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669736] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669775] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669794] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:26.669814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669855] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669889] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669928] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669968] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.669989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670008] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670090] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670129] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670148] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670168] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670188] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670208] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670250] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670269] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670303] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670325] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670356] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670370] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670414] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670429] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670453] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670478] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670520] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670538] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670584] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670605] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670626] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670655] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670675] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670817] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670846] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670887] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670906] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.670997] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671093] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671120] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671159] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671253] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671273] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:26.671313] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:26.671334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:26.671355] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:26.671337] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3983, offset=51255}, end_cursor:ObLogCursor{file_id=3, log_id=3984, offset=51561}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77408050, len:1993, log_data_len:306, seq:3983, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:26.671373] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:26.671392] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:26.671409] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:26.671438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:26.671466] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:26.671490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:26.671515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:26.671546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(dag_cnt=0, total_worker_cnt_=1, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:26.671626] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE40-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:26.671705] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE40-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215706168233002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215706168233002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:26.674855] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE40-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215706674025000, start_id=1745215706674025000, end_id=1745215706674025001) [2025-04-21 14:08:26.676722] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:08:26.676773] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:26.676818] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:26.677958] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3984, offset=51561}, end_cursor:ObLogCursor{file_id=3, log_id=3985, offset=51858}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7740c050, len:1687, log_data_len:297, seq:3984, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:26.678237] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE40-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:26.678306] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE40-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215706168233002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215706168233002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:26.692716] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:26.694862] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.694921] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.695217] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.695281] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.695515] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.695659] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.695869] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.696031] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.696088] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.696141] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.696218] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:26.731019] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.785815] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=51] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:26.807439] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=24] ====== traversal_flush timer task ====== [2025-04-21 14:08:26.807570] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9A-0-0] [lt=58] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:26.807713] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9A-0-0] [lt=135] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:26.818457] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:26.820812] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:26.820872] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=52] temporary file module use no blocks [2025-04-21 14:08:26.820891] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:26.820920] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:26.820939] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254911371018, flush_io_finished_ret_:0, flush_io_finished_round_:98, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:26.827190] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:26.831094] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.831797] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE19-0-0] [lt=42] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:26.831865] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE19-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:26.833459] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:26.834445] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=41] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:26.834506] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=58] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:26.834572] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:26.834673] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:26.834737] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=56] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:26.834766] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215698658513001, v:0}) [2025-04-21 14:08:26.834788] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:26.834808] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:26.834834] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:26.834868] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:26.834900] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:26.834934] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:26.834969] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:26.834990] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:26.853575] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:26.863321] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=76950528) [2025-04-21 14:08:26.863380] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.868904] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1573, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:26.868896] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1400) [2025-04-21 14:08:26.868978] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=8, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1667, avg_log_submit_to_slide_time=1690) [2025-04-21 14:08:26.869054] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:26.869103] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1400, hit_cnt=8, read_cnt=8, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:26.890235] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:26.890333] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=90] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:26.893257] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:26.905970] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=64] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:26.922995] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=43] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:26.929375] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=42] runTimer to refresh locality_info(ret=0) [2025-04-21 14:08:26.931163] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:26.931438] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=29] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:08:26.931500] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=51] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:08:26.931527] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=25] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:08:26.931555] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=20] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:08:26.931572] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:08:26.931594] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:08:26.931605] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=10] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:08:26.931624] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:08:26.942412] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:26.942481] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:26.942786] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8E-0-0] [lt=26] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215701993583, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:26.942847] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8E-0-0] [lt=59] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215701995041, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:26.942868] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8E-0-0] [lt=19] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215701996351, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215701996347, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:26.955331] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=61] current monitor number(seq_=-1) [2025-04-21 14:08:26.967348] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:26.967431] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:26.967455] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=8, avg_log_batch_cnt=1, total_group_log_size=1598, avg_group_log_size=199) [2025-04-21 14:08:26.967481] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1598) [2025-04-21 14:08:26.967502] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:26.969044] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:26.969098] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1560, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:26.969143] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:26.969121] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1598) [2025-04-21 14:08:26.969181] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:26.969219] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1729, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:26.969241] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=8, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1696, avg_log_submit_to_slide_time=1715) [2025-04-21 14:08:26.969293] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:26.969315] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1735, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:26.969342] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:26.969385] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1598, hit_cnt=8, read_cnt=8, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:26.976672] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF003A-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:26.979035] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF003A-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254912529343, cache_obj->added_lc()=false, cache_obj->get_object_id()=641, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:27.004096] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=24] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:27.004135] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=38] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:27.004155] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAF-0-0] [lt=30] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:27.004204] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDAF-0-0] [lt=44] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:27.013159] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:08:27.014707] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=26] no need to update min/max version(new_version={val:1745215706635039000, v:0}, min_version={val:1745215706635039000, v:0}, max_version={val:1745215706635039000, v:0}) [2025-04-21 14:08:27.031235] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.031880] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:27.058650] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=4900000, replace_num=100000) [2025-04-21 14:08:27.058710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:27.063073] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:27.063130] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.090267] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:27.090330] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] try gc retain ctx [2025-04-21 14:08:27.090355] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] try to retry start_working [2025-04-21 14:08:27.090423] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] finish update min start scn(max_decided_scn={val:1745215706916796000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215696907950001, v:0}, keep_alive_scn_:{val:1745215701912141001, v:0}, update_ts_:1745215707089897}) [2025-04-21 14:08:27.092009] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=66] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215715197259000, latest_log_ts:{val:1745215698658513001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:27.093829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:27.094149] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:08:27.094222] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1549, avg_log_submit_to_slide_time=1572) [2025-04-21 14:08:27.111793] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215707012557000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215707111742}, version_delta=99233) [2025-04-21 14:08:27.115168] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=70] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215706916796000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198359, in_cluster_service=true, cluster_version={val:1745215706715854000, v:0}, min_cluster_version={val:1745215706715854000, v:0}, max_cluster_version={val:1745215706715854000, v:0}, get_cluster_version_err=0, cluster_version_delta=399301, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=881, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=44645292, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:27.131316] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.159363] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:27.169281] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1598) [2025-04-21 14:08:27.169513] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=35] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=365, get_gts_with_stc_cnt=30, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:27.169562] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=46] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215707169479], gts:1745215707168956000, latest_srr:[mts=1745215707169479]}) [2025-04-21 14:08:27.197176] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDC-0-0] [lt=27] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:27.197227] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDC-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:27.213398] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF3E-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:27.213664] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:27.213711] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=7795, avg_group_log_size=487) [2025-04-21 14:08:27.214986] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:27.231382] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.238337] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB4-0-0] [lt=43] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:27.238387] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB4-0-0] [lt=43] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=53) [2025-04-21 14:08:27.251356] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:27.251419] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:27.251605] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:27.251802] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:27.251889] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:17, schedule:48, submit:9, rt:1177, total:1251) [2025-04-21 14:08:27.251966] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:27.252027] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:17, schedule:48, submit:9, device:1177, total:1251) [2025-04-21 14:08:27.251997] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1C-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:27.252062] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1C-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:27.252090] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:27.252166] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:660, total:675) [2025-04-21 14:08:27.252244] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:27.252282] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:660, total:675) [2025-04-21 14:08:27.252351] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:27.252379] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:27.258815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:27.290448] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=590] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:27.290521] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:27.291966] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1453, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:27.292017] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:27.292081] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:27.292124] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1592, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:27.292148] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:27.294306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43624087552, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:27.303375] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=10600000, clean_num=200000) [2025-04-21 14:08:27.331452] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.363509] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=76950528) [2025-04-21 14:08:27.363576] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.367681] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:27.367767] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:27.367817] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:27.404211] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1237, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:27.404283] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7795) [2025-04-21 14:08:27.404340] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:27.404386] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7917) [2025-04-21 14:08:27.404472] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:27.404510] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1357, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:27.413626] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1745215707413588000, start_id=1745215707413588000, end_id=1745215707413588001) [2025-04-21 14:08:27.415153] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=1327, avg_log_submit_to_slide_time=1342) [2025-04-21 14:08:27.415239] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7794, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:27.415322] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215707212871000, v:0}, new_max_version={val:1745215707212871000, v:0}, last_min_version={val:1745215707012557000, v:0}, last_max_version={val:1745215707012557000, v:0}, total_time_us=3344, delta_us=202448) [2025-04-21 14:08:27.415379] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215707212871000, v:0}, min_version={val:1745215707212871000, v:0}, max_version={val:1745215707212871000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:27.416492] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:27.418496] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:27.424973] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:27.425054] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=70] temporary file module use no blocks [2025-04-21 14:08:27.425073] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:27.425100] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:27.425128] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254911975195, flush_io_finished_ret_:0, flush_io_finished_round_:99, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:27.427436] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:27.431523] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.442630] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:27.442708] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.458965] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:27.469703] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:27.474870] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.474935] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.474976] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.475868] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.476990] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215707476985, bytes: 4319178, bw: 0.013462 MB/s, add_ts: 1007619, add_bytes: 14223 [2025-04-21 14:08:27.492547] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:08:27.492714] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:27.503857] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=31] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:27.518187] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB7-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:27.531617] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.536257] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=93] PNIO [ratelimit] time: 1745215707536252, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2025-04-21 14:08:27.563314] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:27.563399] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.569882] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:08:27.575801] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:27.575902] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=91] temporary file module use no blocks [2025-04-21 14:08:27.575923] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:27.576000] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=68] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:27.576064] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=62] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254912126005, flush_io_finished_ret_:0, flush_io_finished_round_:99, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:27.583698] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=67] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:27.589028] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:27.599177] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:27.599237] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=45] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=20) [2025-04-21 14:08:27.601911] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:27.601955] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:27.603934] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:27.603971] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:27.631695] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.659132] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:27.669725] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=25] [APPLY STAT CB APPEND COST TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=40, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:27.669825] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=98] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1839, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:27.669851] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=25] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:27.669872] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=19] [APPLY STAT CB EXECUTE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=-505, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:27.669908] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=33] [APPLY STAT CB TOTAL TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1375, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:27.670034] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1745215707669564000, start_id=1745215707669564000, end_id=1745215707669564001) [2025-04-21 14:08:27.670099] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=47] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:27.684188] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3985, offset=51858}, end_cursor:ObLogCursor{file_id=3, log_id=3986, offset=52164}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77410050, len:1390, log_data_len:306, seq:3985, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:27.684611] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE41-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:27.684687] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE41-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215707168956003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215707168956003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:27.687818] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=49] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585097048064, fast_delete_log_mode=false) [2025-04-21 14:08:27.691559] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=77] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3986, offset=52164}, end_cursor:ObLogCursor{file_id=3, log_id=3987, offset=52461}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77414050, len:1084, log_data_len:297, seq:3986, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:27.691883] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE41-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:27.691958] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE41-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215707168956003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215707168956003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:27.695446] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695506] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695555] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695620] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695755] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695877] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695930] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.695967] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.696211] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.696288] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:27.704368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:27.720416] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDD5-0-0] [lt=42] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:27.731831] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:27.731862] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:27.731880] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.747049] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65671882}], scn_array=[cnt:1, {val:1745215707717024000, v:0}], curr_size=585, accum_size=1292, time_cost=29268) [2025-04-21 14:08:27.783461] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDD7-0-0] [lt=70] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:27.783614] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDD9-0-0] [lt=60] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:27.785945] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:27.787529] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=60] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:27.810714] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:27.810789] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=63] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:27.816449] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:27.818528] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:08:27.821091] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:27.821150] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:08:27.821170] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:27.821200] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:27.821226] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254912371303, flush_io_finished_ret_:0, flush_io_finished_round_:99, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:27.821236] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:08:27.827376] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=50] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:27.831846] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.833749] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1A-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:27.833827] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1A-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:27.834470] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=108] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:27.859292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:27.863674] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=33] LogLoopThread round_cost_time(us)(round_cost_time=22) [2025-04-21 14:08:27.863714] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:27.863774] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.869978] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1661, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:27.870121] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:27.870201] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1844, avg_log_submit_to_slide_time=1869) [2025-04-21 14:08:27.870266] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:27.870315] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:27.890990] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3526, avg_group_log_size=352) [2025-04-21 14:08:27.891062] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3526) [2025-04-21 14:08:27.902041] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=24][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:27.902197] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=54][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:27.904919] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:27.905726] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC4-0-0] [lt=33] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215707905702}) [2025-04-21 14:08:27.905804] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC4-0-0] [lt=43] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215707905795}) [2025-04-21 14:08:27.905796] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE0-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215707905765, sql_renew_time:1745215707905765, is_mark_fail:false}]) [2025-04-21 14:08:27.905852] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE0-0-0] [lt=55] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215707905702}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215707905765, sql_renew_time:1745215707905765, is_mark_fail:false}]) [2025-04-21 14:08:27.905896] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE1-0-0] [lt=32] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:27.906407] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE1-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215707906394, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:27.906448] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE1-0-0] [lt=39] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215707905795}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215707906394, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:27.907597] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC4-0-0] [lt=31] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:27.911015] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDDB-0-0] [lt=23] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:27.913555] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=42] ls blacklist refresh finish(cost_time=9440) [2025-04-21 14:08:27.931928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:27.942902] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:27.942999] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=88] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:27.968196] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:27.968321] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:27.968361] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:27.968404] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:27.968442] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:27.970133] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1740, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:27.970192] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:27.970203] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:27.970310] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:27.970354] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1919, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:27.970381] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:27.970423] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:27.970461] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:27.970483] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1864, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:27.970505] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1838, avg_log_submit_to_slide_time=1853) [2025-04-21 14:08:27.970560] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:27.982877] WDIAG begin (ob_hashtable.h:954) [620071][T1_L0_G0][T1][YB420B1D7AB6-00063343B8AEFD87-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:27.985530] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620071][T1_L0_G0][T1][YB420B1D7AB6-00063343B8AEFD87-0-0] [lt=53][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254913535829, cache_obj->added_lc()=false, cache_obj->get_object_id()=642, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:28.014538] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7794) [2025-04-21 14:08:28.015778] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFDE0-0-0] [lt=77] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:08:28.028676] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=39] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:28.032018] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.032050] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:28.048247] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=17] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:28.048546] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=111] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:28.048592] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=43] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=153, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:28.048679] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=33] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:28.048798] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:28.048822] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=9, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:28.059460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:28.063547] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:28.063613] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.105464] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:28.120263] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4120) [2025-04-21 14:08:28.120342] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=4221, avg_log_submit_to_slide_time=4244) [2025-04-21 14:08:28.132099] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.170492] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:28.199077] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDD-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:28.199139] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDD-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:28.204952] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=25909999, this={dio_aligned_buf:{buf_write_offset:2921, buf_padding_size:1175, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4972, truncate_used_ts:2037}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=25907200, buf_len=122, total_write_size=85913, total_write_size_after_dio=790528, ob_pwrite_used_ts=238205, count=172, each_pwrite_cost=1384) [2025-04-21 14:08:28.213991] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF43-0-0] [lt=56] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215708213275, can_tenant_elr:true}) [2025-04-21 14:08:28.214204] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF43-0-0] [lt=45] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082465362548828125e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584706584993681417e+02) [2025-04-21 14:08:28.214509] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:28.214561] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8383, avg_group_log_size=493) [2025-04-21 14:08:28.216283] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:28.232166] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.253521] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:28.253628] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:28.253852] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1D-0-0] [lt=26] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:28.253866] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:28.253917] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1D-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:28.254100] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:28.254220] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:18, schedule:48, submit:8, rt:1351, total:1427) [2025-04-21 14:08:28.254325] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:28.254424] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=89] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:18, schedule:48, submit:8, device:1351, total:1427) [2025-04-21 14:08:28.254509] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:28.254614] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:776, total:791) [2025-04-21 14:08:28.254730] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:28.254824] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=85] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4085, [delay/us]: prepare:0, schedule:0, submit:600000000, device:776, total:791) [2025-04-21 14:08:28.254911] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:28.254957] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:28.259607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:28.291289] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:28.291367] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:28.293023] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=90] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4433, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:28.293054] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:28.293077] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:28.293143] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:28.293173] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4585, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:28.293208] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:28.294380] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:28.294505] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=51] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215701156150000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:28.305952] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:28.332238] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.363900] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:28.363968] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.368530] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:28.368601] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:28.368630] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:28.382515] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8726303}], scn_array=[cnt:1, {val:1745215708170264001, v:0}], curr_size=122, accum_size=244, time_cost=13803) [2025-04-21 14:08:28.382590] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17314039}], scn_array=[cnt:1, {val:1745215708170264001, v:0}], curr_size=122, accum_size=1098, time_cost=14042) [2025-04-21 14:08:28.388348] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=57] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:28.400879] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:28.400943] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=54] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:28.405225] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=74] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1647, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:28.405295] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=66] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8383) [2025-04-21 14:08:28.405342] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:28.405398] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8383) [2025-04-21 14:08:28.405468] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:28.405496] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1832, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:28.416581] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=43, avg_log_gen_to_submit_time=61, avg_log_submit_to_flush_time=1767, avg_log_submit_to_slide_time=1788) [2025-04-21 14:08:28.416651] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8384, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:28.416786] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215708214345000, v:0}, new_max_version={val:1745215708214345000, v:0}, last_min_version={val:1745215708013902000, v:0}, last_max_version={val:1745215708013902000, v:0}, total_time_us=3941, delta_us=202436) [2025-04-21 14:08:28.416846] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215708214345000, v:0}, min_version={val:1745215708214345000, v:0}, max_version={val:1745215708214345000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:28.417608] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:28.418569] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:28.425277] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:28.425333] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:28.425363] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:28.425392] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:28.425411] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254912975488, flush_io_finished_ret_:0, flush_io_finished_round_:100, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:28.427564] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:28.432308] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.443151] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:28.443231] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.459761] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:28.470313] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:28.475031] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.475097] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.475713] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.475965] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.476628] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=38] ====== tenant freeze timer task ====== [2025-04-21 14:08:28.484607] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1745215708484602, bytes: 4332443, bw: 0.012555 MB/s, add_ts: 1007617, add_bytes: 13265 [2025-04-21 14:08:28.492942] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:08:28.493096] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=82] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:28.497519] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:28.506434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:28.518333] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=85] get number(ret=0, service_type_=0, range=1, base_id=1745215708517431000, start_id=1745215708517431000, end_id=1745215708517431001) [2025-04-21 14:08:28.523793] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:28.525044] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=51] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:28.525151] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215705554947000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:28.532389] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.543871] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215708543866, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2025-04-21 14:08:28.551083] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620299][T1002_ObXAHbWor][T1002][Y0-0000000000000000-0-0] [lt=47] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:08:28.555447] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=55] clear dtl interm result cost(us)(clear_cost=382, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:28.560454] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF003D-0-0] [lt=55][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:28.560979] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8A-0-0] [lt=38] MediumCheckTask(cost_ts=12) [2025-04-21 14:08:28.562161] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=31] ====== traversal_flush timer task ====== [2025-04-21 14:08:28.562292] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD99-0-0] [lt=39] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215708170264002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215705167017003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:28.562464] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD99-0-0] [lt=123] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215705167017003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:28.562540] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD99-0-0] [lt=73] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:28.563151] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF003D-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254914113458, cache_obj->added_lc()=false, cache_obj->get_object_id()=643, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:28.563762] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:28.563834] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.564683] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0041-0-0] [lt=39][errcode=-4201] hashtable not init [2025-04-21 14:08:28.564737] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0041-0-0] [lt=52] get cursor info failed(cursor_id=33, get_sessid()=3221487630) [2025-04-21 14:08:28.564967] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=24] submit log success(service_type_=0, last_id=1745215725197259000, limited_id=1745215725197259000) [2025-04-21 14:08:28.565016] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=33] submit log with lock success(service_type_=0, last_id=1745215725197259000, limited_id=1745215725197259000) [2025-04-21 14:08:28.565041] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215708564600000, start_id=1745215708564600000, end_id=1745215708564600001) [2025-04-21 14:08:28.565223] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=34] ====== check clog disk timer task ====== [2025-04-21 14:08:28.565267] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=34] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:28.566806] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215725197259000, latest_scn={val:1745215708564600001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:28.566911] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=104] handle submit callback(service_type_=0, success=true, used_ts=1944, log_ts={val:1745215708564600001, v:0}, limited_id=1745215725197259000) [2025-04-21 14:08:28.566941] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=28] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:28.566964] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=22] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:28.567565] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0034-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215708566730000, start_id=1745215708566730000, end_id=1745215708566730001) [2025-04-21 14:08:28.569934] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:28.589200] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:28.601746] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:28.601800] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:28.603528] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:28.603567] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:28.631310] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] ====== checkpoint timer task ====== [2025-04-21 14:08:28.632356] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=53] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:28.632425] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=67] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:28.632477] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.632514] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=51] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215705167017003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:28.632619] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:28.632647] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:28.632668] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1745215704165731001, v:0}) [2025-04-21 14:08:28.632683] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:28.632702] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:28.632730] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:28.632748] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:28.632775] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:28.632804] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:28.633803] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:28.633843] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:28.633894] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215705167017003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:28.633962] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=66] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:28.633979] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:28.634003] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:28.634027] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:28.634049] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:28.634072] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:28.634100] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:28.634118] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:28.638681] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:28.638868] WDIAG read_multi_row (ob_table_access_helper.h:238) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:28.640630] INFO delete_row (ob_table_access_helper.h:312) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215708638901) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215708638901) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:28.640774] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:28.659889] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:28.662631] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=62] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:28.670820] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=28] [APPLY STAT CB APPEND COST TIME](cur_stat_count=28, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:28.670896] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=74] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=28, stat_interval=5000000, avg (count/cost)=1845, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:28.670917] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=28, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:28.670945] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=26] [APPLY STAT CB EXECUTE TIME](cur_stat_count=28, stat_interval=5000000, avg (count/cost)=-500, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:28.670966] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF72-0-0] [lt=20] [APPLY STAT CB TOTAL TIME](cur_stat_count=28, stat_interval=5000000, avg (count/cost)=1407, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:28.671093] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=32] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:28.671369] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215708671353], gts:1745215708670854000, latest_srr:[mts=1745215708671353]}) [2025-04-21 14:08:28.678293] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:08:28.678353] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=47] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:28.678412] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:28.695551] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=54] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695652] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695710] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695710] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695753] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.695767] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.696294] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.696364] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.696426] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.696457] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:28.698002] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3987, offset=52461}, end_cursor:ObLogCursor{file_id=3, log_id=3988, offset=52767}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77418050, len:787, log_data_len:306, seq:3987, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:28.698388] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE42-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:28.698462] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE42-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215708170264003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215708170264003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:28.704937] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3988, offset=52767}, end_cursor:ObLogCursor{file_id=3, log_id=3989, offset=53064}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7741c050, len:481, log_data_len:297, seq:3988, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:28.705314] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE42-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:28.705385] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE42-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215708170264003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215708170264003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:28.706976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:28.732550] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.762084] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9B-0-0] [lt=62] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:28.767020] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=34] ObArchiveSender is running(thread_index=1) [2025-04-21 14:08:28.768766] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:28.768811] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] try gc retain ctx [2025-04-21 14:08:28.768826] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:28.768883] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215708170264004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215698658513001, v:0}, keep_alive_scn_:{val:1745215703664829000, v:0}, update_ts_:1745215708768147}) [2025-04-21 14:08:28.769908] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215706635039000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:28.770095] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=106] finish update min start scn(max_decided_scn={val:1745215708170264004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215698658513001, v:0}, keep_alive_scn_:{val:1745215703664829000, v:0}, update_ts_:1745215708769232}) [2025-04-21 14:08:28.771105] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215706635039000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:28.786077] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:28.808427] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=55][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:28.818615] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=46] gc stale ls task succ [2025-04-21 14:08:28.827535] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:28.832624] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:28.835428] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1B-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:28.835493] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1B-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:28.860012] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:28.864074] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:28.864138] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.868730] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:28.868778] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=46] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:28.869408] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] update_check_range(min_check_version=9, max_check_version=10, global_version=11) [2025-04-21 14:08:28.870923] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2961, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:28.871089] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:28.871146] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:28.871193] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=3216, avg_log_submit_to_slide_time=3232) [2025-04-21 14:08:28.871252] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:28.885253] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:28.887199] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] get number(ret=0, service_type_=0, range=1, base_id=1745215708886234000, start_id=1745215708886234000, end_id=1745215708886234001) [2025-04-21 14:08:28.891839] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4222, avg_group_log_size=351) [2025-04-21 14:08:28.891895] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4222) [2025-04-21 14:08:28.892772] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=30] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 164 249 0 1 2 87 1 0 1 4 1 1 0 1 5 43 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 233 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 21 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 86 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 20 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 92 245 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 23415 [2025-04-21 14:08:28.892856] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=53] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,072,775,168 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 460,386,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 90,177,536 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:28.893186] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 460,386,304 used= 384,176,240 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 28 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,767,744 used= 4,194,304 count= 70 avg_used= 59,918 block_cnt= 70 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,150,464 used= 3,020,064 count= 652 avg_used= 4,632 block_cnt= 652 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,374,720 used= 1,301,088 count= 36 avg_used= 36,141 block_cnt= 36 chunk_cnt= 10 mod=CommSysVarFac [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,179,648 used= 1,159,936 count= 8 avg_used= 144,992 block_cnt= 8 chunk_cnt= 8 mod=SQLSessionInfo [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 601,472 used= 587,264 count= 74 avg_used= 7,936 block_cnt= 74 chunk_cnt= 13 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 378,880 used= 363,520 count= 80 avg_used= 4,544 block_cnt= 80 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 195,072 used= 190,464 count= 24 avg_used= 7,936 block_cnt= 24 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 83,016 count= 9 avg_used= 9,224 block_cnt= 9 chunk_cnt= 6 mod=[T]ObDSActionAr [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,464 used= 6,144 count= 12 avg_used= 512 block_cnt= 11 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,176,240 used= 376,055,116 count= 32,161 avg_used= 11,692 mod=SUMMARY [2025-04-21 14:08:28.893242] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:08:28.893269] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:08:28.893292] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 90,177,536 used= 86,713,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 81,809,536 used= 74,307,679 count= 3,701 avg_used= 20,077 block_cnt= 3,701 chunk_cnt= 43 mod=SqlPhyPlan [MEMORY] hold= 3,484,992 used= 3,278,864 count= 360 avg_used= 9,107 block_cnt= 360 chunk_cnt= 43 mod=SqlPlanCache [MEMORY] hold= 1,416,576 used= 1,291,584 count= 651 avg_used= 1,984 block_cnt= 217 chunk_cnt= 42 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 86,713,088 used= 78,879,727 count= 4,714 avg_used= 16,733 mod=SUMMARY [2025-04-21 14:08:28.893320] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:08:28.893346] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:08:28.893384] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:08:28.893416] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:08:28.893443] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:28.893470] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:28.893497] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:08:28.893536] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,691,392 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,820,672 used= 1,777,664 count= 224 avg_used= 7,936 block_cnt= 224 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,691,392 used= 19,619,392 count= 228 avg_used= 86,049 mod=SUMMARY [2025-04-21 14:08:28.893567] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:08:28.893605] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:08:28.893645] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 774,303,744 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 225,513,472 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:28.893933] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,124,752 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:28.943424] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:28.955562] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=51] current monitor number(seq_=-1) [2025-04-21 14:08:28.968980] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=71] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:28.969074] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:28.969109] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:28.969142] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:28.969171] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:28.970912] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3086, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:28.970989] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:28.971011] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:28.971059] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:28.971099] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3264, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:28.971130] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:28.971160] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:28.971193] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=22, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:28.971212] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3131, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:28.971231] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=3104, avg_log_submit_to_slide_time=3120) [2025-04-21 14:08:28.971286] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:28.989809] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0043-0-0] [lt=22][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:28.992388] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0043-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254914542693, cache_obj->added_lc()=false, cache_obj->get_object_id()=644, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:29.004906] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=24] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:29.004959] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=52] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:29.004957] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB0-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:29.005022] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB0-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:29.005775] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=57, stat_interval=5000000, avg (count/cost)=53, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:29.005826] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=49] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=57, stat_interval=5000000, avg (count/cost)=1613, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:29.005850] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=23] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=57, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:29.005869] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=57, stat_interval=5000000, avg (count/cost)=-479, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:29.005888] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=57, stat_interval=5000000, avg (count/cost)=1187, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:29.013228] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215708706429000, v:0}, base_version={val:1745215708613813000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215708706429000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215708913186, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:29.014880] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF47-0-0] [lt=57] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=404, Holding Memory(MB)=68, Tenant Remain Memory(MB)=560, Usable Remain Memory(MB)=336, Last Update Limit Timestamp=1745215709014087, Is Updated=true) [2025-04-21 14:08:29.015196] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=10139) [2025-04-21 14:08:29.016387] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=83] no need to update min/max version(new_version={val:1745215708170264004, v:0}, min_version={val:1745215708170264004, v:0}, max_version={val:1745215708170264004, v:0}) [2025-04-21 14:08:29.016433] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215620564480, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:29.016845] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] get_max_applied_scn(scn={val:1745215708918503000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65677396}, palf_committed_end_scn_:{val:1745215708918503000, v:0}, last_check_scn_:{val:1745215708918503000, v:0}, max_applied_cb_scn_:{val:1745215708918503000, v:0}}) [2025-04-21 14:08:29.016901] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65677396}, readable_log_tail:{lsn:65677396}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1427372, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:29.022273] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get_max_applied_scn(scn={val:1745215708886234000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25915453}, palf_committed_end_scn_:{val:1745215709014087000, v:0}, last_check_scn_:{val:1745215709014087000, v:0}, max_applied_cb_scn_:{val:1745215708886234000, v:0}}) [2025-04-21 14:08:29.022357] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25915453}, readable_log_tail:{lsn:25915453}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41189315, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:29.032180] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=47] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:29.032784] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.048219] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:29.048327] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=89] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:29.048376] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=44] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:29.048416] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=37] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:29.052353] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=29] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:29.053061] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=702] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:29.055053] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=28] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:136938871, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:68, recv_lp_rpc_cnt:0, recv_mysql_cnt:893, recv_task_cnt:79, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:318074, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:46, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:92, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:382, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x40e:cnt=9 pcode=0x152:cnt=5, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:08:29.055783] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=729] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:08:29.055826] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=41] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:8171304, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:542616, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:08:29.056441] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=614] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:08:29.056466] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=24] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:6793098, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:271245, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:08:29.057079] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=612] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:08:29.057096] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=15] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:41894222, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:86, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:41343, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:370, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=9, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:08:29.057839] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=742] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:08:29.057868] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=28] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:67887439, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:514, recv_task_cnt:50, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:40289, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:173, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215681312860}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:718, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=20, token_change_ts:1745215608569663, tenant_role:1}) [2025-04-21 14:08:29.058628] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=759] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:08:29.060170] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:29.063990] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:29.064048] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.107957] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:29.118461] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215709115361000, start_id=1745215709115361000, end_id=1745215709115361001) [2025-04-21 14:08:29.132873] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.138969] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=127] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1001, is_allowed_broadcast=true) [2025-04-21 14:08:29.168838] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=78] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:29.171621] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=35] ts response task statistics(alloc_count=2166, free_count=1082) [2025-04-21 14:08:29.171910] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=41] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=370, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:29.200929] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDE-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:29.200987] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDE-0-0] [lt=56] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:29.215214] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=107] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:29.215273] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=10017, avg_group_log_size=556) [2025-04-21 14:08:29.216608] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_max_applied_scn(scn={val:1745215708670854003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17315128}, palf_committed_end_scn_:{val:1745215708670854004, v:0}, last_check_scn_:{val:1745215708670854004, v:0}, max_applied_cb_scn_:{val:1745215708670854003, v:0}}) [2025-04-21 14:08:29.216671] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17315128}, readable_log_tail:{lsn:17315128}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49789640, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:29.217038] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:29.217089] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082616710662841797e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.584216414210336552e+02) [2025-04-21 14:08:29.232964] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.238953] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB5-0-0] [lt=43] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:29.239007] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB5-0-0] [lt=46] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=56) [2025-04-21 14:08:29.255699] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1E-0-0] [lt=25] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:29.255766] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1E-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:29.255969] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:29.256030] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:29.256218] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:29.256407] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:29.256495] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:16, schedule:34, submit:9, rt:1286, total:1346) [2025-04-21 14:08:29.256578] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:29.256646] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:16, schedule:34, submit:9, device:1286, total:1346) [2025-04-21 14:08:29.256708] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:29.256785] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:949, total:969) [2025-04-21 14:08:29.256863] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:29.256901] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:949, total:969) [2025-04-21 14:08:29.256965] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:29.256995] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:29.265211] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5000000, replace_num=100000) [2025-04-21 14:08:29.265260] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:29.270784] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:08:29.275765] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=54] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:29.279654] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=61] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:29.292129] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:29.292191] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:29.293508] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1492, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:29.293560] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:29.293600] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4344) [2025-04-21 14:08:29.293650] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:29.293672] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1756, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:29.293693] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=132, avg_log_gen_to_submit_time=155, avg_log_submit_to_flush_time=1589, avg_log_submit_to_slide_time=1609) [2025-04-21 14:08:29.293729] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:29.308441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:29.317592] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=10800000, clean_num=200000) [2025-04-21 14:08:29.320414] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=106] get_max_applied_scn(scn={val:1745215708670854004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8727514}, palf_committed_end_scn_:{val:1745215709171271000, v:0}, last_check_scn_:{val:1745215709171271000, v:0}, max_applied_cb_scn_:{val:1745215708670854004, v:0}}) [2025-04-21 14:08:29.320473] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=53] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8727514}, readable_log_tail:{lsn:8727514}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58377254, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:29.333053] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.364239] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:29.364288] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.369385] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:29.369436] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:29.369468] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:29.397900] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=38] ====== traversal_flush timer task ====== [2025-04-21 14:08:29.398047] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9A-0-0] [lt=42] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215709215053000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:29.398178] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9A-0-0] [lt=123] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:29.398798] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:29.398851] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:29.398881] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=26] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=21) [2025-04-21 14:08:29.402239] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE2-0-0] [lt=19] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:29.402674] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE2-0-0] [lt=39] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215709402650, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:29.402729] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE2-0-0] [lt=54] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215709402170}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215709402650, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:29.417590] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1776, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:29.417636] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=10484) [2025-04-21 14:08:29.417679] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:29.417724] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10484) [2025-04-21 14:08:29.417786] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:29.417826] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1923, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:29.417849] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1891, avg_log_submit_to_slide_time=1911) [2025-04-21 14:08:29.417920] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9895, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:29.418063] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215709215053000, v:0}, new_max_version={val:1745215709215053000, v:0}, last_min_version={val:1745215709014087000, v:0}, last_max_version={val:1745215709014087000, v:0}, total_time_us=4528, delta_us=203006) [2025-04-21 14:08:29.418124] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215709215053000, v:0}, min_version={val:1745215709215053000, v:0}, max_version={val:1745215709215053000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:29.418675] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:29.425551] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:29.425603] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:29.425627] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:29.425654] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:29.425679] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254913975773, flush_io_finished_ret_:0, flush_io_finished_round_:101, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:29.427737] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:29.428764] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:29.429726] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:29.429789] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=62] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:29.429861] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:29.429962] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:29.430007] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:29.430033] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215701407093001, v:0}) [2025-04-21 14:08:29.430052] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:29.430069] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:29.430087] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:29.430116] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:29.430140] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:29.430170] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:29.430203] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:29.430224] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:29.433093] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.443549] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:29.443600] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.465389] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:29.471393] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:29.475112] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.475157] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.475185] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.476171] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.478388] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=48] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:29.485604] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFDE0-0-0] [lt=91][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:08:29.492215] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215709492210, bytes: 4347159, bw: 0.013928 MB/s, add_ts: 1007608, add_bytes: 14716 [2025-04-21 14:08:29.493729] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4222) [2025-04-21 14:08:29.493859] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4222, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:29.518113] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:29.519111] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=104] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:29.524323] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB8-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:29.533206] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.551490] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1745215709551484, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:08:29.560581] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0045-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:29.563042] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0045-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254915113349, cache_obj->added_lc()=false, cache_obj->get_object_id()=645, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:29.564197] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:29.564276] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.570004] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:08:29.576358] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=93] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:29.576444] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=75] temporary file module use no blocks [2025-04-21 14:08:29.576479] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=32] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:29.576520] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:29.576563] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=41] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254914126557, flush_io_finished_ret_:0, flush_io_finished_round_:101, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:29.589358] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:29.601913] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:29.601972] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:29.603938] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:29.603974] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:29.604187] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:29.604244] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=55] try gc retain ctx [2025-04-21 14:08:29.604259] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:29.604318] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215709415684000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215699586888001, v:0}, keep_alive_scn_:{val:1745215704414040002, v:0}, update_ts_:1745215709603329}) [2025-04-21 14:08:29.605300] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215717945792000, latest_log_ts:{val:1745215701407093001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:29.633374] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.650156] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:29.651407] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=52] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:29.651514] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215708742072000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:29.652047] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=30] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:29.652127] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=59] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=19) [2025-04-21 14:08:29.652953] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:29.653032] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=44] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:29.653069] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=33] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:29.653092] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=19) [2025-04-21 14:08:29.665554] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:29.672194] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=32] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:29.672265] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=401, get_gts_with_stc_cnt=60, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=59, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:29.672291] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215709672248], gts:1745215709671917000, latest_srr:[mts=1745215709672248]}) [2025-04-21 14:08:29.687956] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=27] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:29.688058] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=78] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=21) [2025-04-21 14:08:29.691395] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=32] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:29.691455] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=46] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:29.691483] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=21) [2025-04-21 14:08:29.694931] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.694992] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.695393] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.695647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.695727] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.695781] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.695815] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.696277] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.696359] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.696379] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.696544] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:29.711855] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3989, offset=53064}, end_cursor:ObLogCursor{file_id=3, log_id=3990, offset=53370}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77420050, len:4280, log_data_len:306, seq:3989, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:29.712258] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE43-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:29.712326] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE43-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215709171271003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215709171271003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:29.713795] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215709518602000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=195174, in_cluster_service=true, cluster_version={val:1745215709415684000, v:0}, min_cluster_version={val:1745215709415684000, v:0}, max_cluster_version={val:1745215709415684000, v:0}, get_cluster_version_err=0, cluster_version_delta=298092, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=878, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=44534369, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:29.718652] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:29.719502] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=63] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3990, offset=53370}, end_cursor:ObLogCursor{file_id=3, log_id=3991, offset=53667}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77424050, len:3974, log_data_len:297, seq:3990, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:29.719863] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE43-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:29.719933] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE43-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215709171271004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215709171271004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:29.733441] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.786209] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:29.800293] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17315738}], scn_array=[cnt:1, {val:1745215709671917000, v:0}], curr_size=122, accum_size=366, time_cost=30568) [2025-04-21 14:08:29.800361] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8728002}], scn_array=[cnt:1, {val:1745215709671917000, v:0}], curr_size=122, accum_size=610, time_cost=30611) [2025-04-21 14:08:29.810926] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:29.811004] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=65] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:29.818699] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:08:29.821471] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:29.821527] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:29.821547] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:29.821577] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:29.821598] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254914371697, flush_io_finished_ret_:0, flush_io_finished_round_:101, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:29.822830] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=38] ====== tenant freeze timer task ====== [2025-04-21 14:08:29.827666] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:29.833520] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.837152] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1D-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:29.837217] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1D-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:29.842868] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:29.864405] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:29.864495] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=81] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.865699] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:29.868181] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=30] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65680223}, readable_log_tail:{lsn:65680223}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1424545, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:29.868340] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=156] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:29.868387] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=22] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:29.871718] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4595, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:29.871738] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:29.871806] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=4724, avg_log_submit_to_slide_time=4740) [2025-04-21 14:08:29.871872] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:29.871919] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:29.878760] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=11, gc_interval=10000000) [2025-04-21 14:08:29.878844] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=44] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:29.878879] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=24] gc_check_member_list_ cost time(ret=0, time_us=72) [2025-04-21 14:08:29.878910] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=24] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:29.878940] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:29.878969] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:29.878992] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=25) [2025-04-21 14:08:29.879012] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyHandler start process [2025-04-21 14:08:29.880289] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:29.880370] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=71] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:29.880408] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=36] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:29.880433] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:29.883797] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:29.884508] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=708] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:29.889532] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=63] finish to resize log external storage handler(current_ts=1745215709889528, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:29.892594] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:29.892644] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:08:29.919203] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:29.923133] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=44] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:29.933589] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:29.937617] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=44] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14304, max_lsn:65680930, max_scn:{val:1745215709918087000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65680930}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65680345}, last_submit_end_lsn:{lsn:65680930}, last_submit_log_id:14304, last_submit_log_pid:3, max_flushed_lsn:{lsn:65680345}, max_flushed_end_lsn:{lsn:65680930}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65680930}, last_slide_log_id:14304, last_slide_scn:{val:1745215709918087000, v:0}, last_slide_lsn:{lsn:65680345}, last_slide_end_lsn:{lsn:65680930}, last_slide_log_pid:3, last_slide_log_accum_checksum:4128744540, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14305, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65680930}, readable_log_tail:{lsn:65680930}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1423838, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:29.937882] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=256] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215709920602, last_flushed_end_lsn:{lsn:65680930}}]) [2025-04-21 14:08:29.937908] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=21] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14305, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215709920602, last_flushed_end_lsn:{lsn:65680930}}]) [2025-04-21 14:08:29.939913] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:29.941387] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215709940682000, start_id=1745215709940682000, end_id=1745215709940682001) [2025-04-21 14:08:29.943726] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:29.943778] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:29.959572] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=53] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:29.969864] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:29.969944] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:29.969978] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:29.970010] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:29.970038] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:29.971463] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4597, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:29.971515] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:29.971557] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:29.971566] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:29.971601] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4734, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:29.971632] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:29.971662] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:29.971696] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:29.971717] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4686, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:29.971736] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=4662, avg_log_submit_to_slide_time=4676) [2025-04-21 14:08:29.971791] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:29.995699] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0047-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:29.998205] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0047-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254915548512, cache_obj->added_lc()=false, cache_obj->get_object_id()=646, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:30.015841] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=95] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7888) [2025-04-21 14:08:30.023121] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=67] BlockGCTimerTask success(ret=0, cost_time_us=13, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:30.032322] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=58] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:30.033667] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.037676] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=348) [2025-04-21 14:08:30.058915] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=76] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:08:30.064408] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:30.064476] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.065832] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:30.119726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:30.121977] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215620564480, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:30.133756] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.172759] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215710172724], gts:1745215710172577000, latest_srr:[mts=1745215710172724]}) [2025-04-21 14:08:30.202942] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDF-0-0] [lt=39] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:30.203014] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDDF-0-0] [lt=69] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:30.216122] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:30.216196] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7888, avg_group_log_size=606) [2025-04-21 14:08:30.218103] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:30.233830] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.257593] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1F-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:30.257667] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE1F-0-0] [lt=70] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:30.258079] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:30.258143] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:30.258334] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:30.258524] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:30.258608] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:17, schedule:42, submit:10, rt:1642, total:1712) [2025-04-21 14:08:30.258713] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:30.258780] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12261, [delay/us]: prepare:17, schedule:42, submit:10, device:1642, total:1712) [2025-04-21 14:08:30.258846] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:30.258923] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:770, total:786) [2025-04-21 14:08:30.259001] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:30.259041] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:770, total:786) [2025-04-21 14:08:30.259104] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:30.259132] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:30.265971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:30.271708] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:30.292879] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:30.292949] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:30.294294] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1488, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:30.294350] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:30.294399] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4078) [2025-04-21 14:08:30.294461] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:30.294484] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1609, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:30.294506] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1567, avg_log_submit_to_slide_time=1585) [2025-04-21 14:08:30.294542] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:30.319297] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF57-0-0] [lt=57] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:30.320279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:30.333902] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.364608] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:30.364683] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.370180] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:30.370245] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:30.370274] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:30.401115] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:08:30.401170] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=48] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:30.405085] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=72] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:30.417750] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1582, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:30.417807] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7888) [2025-04-21 14:08:30.417845] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:30.417878] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7888) [2025-04-21 14:08:30.417951] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:30.417985] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1716, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:30.418007] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1670, avg_log_submit_to_slide_time=1691) [2025-04-21 14:08:30.418093] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7888, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:30.418320] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215710215581000, v:0}, new_max_version={val:1745215710215581000, v:0}, last_min_version={val:1745215710015635000, v:0}, last_max_version={val:1745215710015635000, v:0}, total_time_us=3990, delta_us=202734) [2025-04-21 14:08:30.418387] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215710215581000, v:0}, min_version={val:1745215710215581000, v:0}, max_version={val:1745215710215581000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:30.418763] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:08:30.425827] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:30.425884] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:30.425903] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:30.425932] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:30.425961] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254914976036, flush_io_finished_ret_:0, flush_io_finished_round_:102, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:30.427908] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:30.433982] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.443902] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:30.443967] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.461982] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=81][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:30.466118] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:30.472287] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:30.474705] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.475253] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.475318] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.475564] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.478377] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:08:30.484709] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=46] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1002, avail_memory=53687091, chunk_count_=0, avail_sort_memory_=53687091, avail_memory_=53687091) [2025-04-21 14:08:30.490025] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=46] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:08:30.490098] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=65] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:08:30.494678] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4078) [2025-04-21 14:08:30.494906] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4078, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:30.499857] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215710499853, bytes: 4359931, bw: 0.012088 MB/s, add_ts: 1007643, add_bytes: 12772 [2025-04-21 14:08:30.506361] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=86] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:30.520113] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:30.523647] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:30.534074] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.559108] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1745215710559101, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2025-04-21 14:08:30.564650] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:30.564731] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.565416] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:30.565471] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:30.570072] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=33] gc stale ls task succ [2025-04-21 14:08:30.572477] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=51] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:30.576791] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=62] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:30.576857] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=56] temporary file module use no blocks [2025-04-21 14:08:30.576876] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:30.576907] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:30.576936] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254915126943, flush_io_finished_ret_:0, flush_io_finished_round_:102, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:30.589538] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:30.601946] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:30.601996] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:30.603762] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:30.603801] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:30.634159] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.666306] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:30.672395] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17320932, this={dio_aligned_buf:{buf_write_offset:3166, buf_padding_size:930, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2284, truncate_used_ts:848}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17317888, buf_len=122, total_write_size=13597, total_write_size_after_dio=417792, ob_pwrite_used_ts=205208, count=99, each_pwrite_cost=2072) [2025-04-21 14:08:30.673350] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=70] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:30.679874] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] ====== tenant freeze timer task ====== [2025-04-21 14:08:30.679934] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=48] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:30.679985] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:30.689848] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:30.689994] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=44][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:30.695366] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695422] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695427] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695444] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695477] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695485] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.695725] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.696018] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=55] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.696042] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.696084] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.696478] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:30.722473] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDD7-0-0] [lt=60] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:30.722712] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDD9-0-0] [lt=94] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:30.724166] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:30.727207] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3991, offset=53667}, end_cursor:ObLogCursor{file_id=3, log_id=3992, offset=53973}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77428050, len:3677, log_data_len:306, seq:3991, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:30.727569] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE44-0-0] [lt=44] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:30.727638] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE44-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215710172577004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215710172577004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:30.731359] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE44-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215710730703000, start_id=1745215710730703000, end_id=1745215710730703001) [2025-04-21 14:08:30.734306] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:30.734343] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=35] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:30.734326] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=68] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3992, offset=53973}, end_cursor:ObLogCursor{file_id=3, log_id=3993, offset=54270}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7742c050, len:3371, log_data_len:297, seq:3992, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:30.734368] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.734764] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE44-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:30.734840] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE44-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215710172577004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215710172577004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:30.735791] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=64] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:30.785878] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDDB-0-0] [lt=20] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:30.786340] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:30.818789] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=56] gc stale ls task succ [2025-04-21 14:08:30.821760] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=58] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:30.821828] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=58] temporary file module use no blocks [2025-04-21 14:08:30.821856] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:30.821887] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:30.821914] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254915371974, flush_io_finished_ret_:0, flush_io_finished_round_:102, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:30.827847] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:30.834324] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.839232] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1E-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:30.839310] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1E-0-0] [lt=76] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:30.864942] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=2, size_used=0, mem_used=79030272) [2025-04-21 14:08:30.865179] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=214] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.866507] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=92] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:30.872785] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:30.872837] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1751, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:30.872924] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=109] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1825, avg_log_submit_to_slide_time=1852) [2025-04-21 14:08:30.873035] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:30.873107] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:30.893412] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4079, avg_group_log_size=370) [2025-04-21 14:08:30.893500] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=82] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4079) [2025-04-21 14:08:30.895326] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=34] [APPLY STAT CB APPEND COST TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:30.895384] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=57] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=2293, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:30.895401] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:30.895432] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=29] [APPLY STAT CB EXECUTE TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=-529, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:30.895454] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0042-0-0] [lt=20] [APPLY STAT CB TOTAL TIME](cur_stat_count=45, stat_interval=5000000, avg (count/cost)=1826, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:30.908091] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC6-0-0] [lt=45] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:30.913306] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDDD-0-0] [lt=58] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:30.915812] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=58] start to print blacklist info [2025-04-21 14:08:30.916057] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=45] ls blacklist refresh finish(cost_time=11820) [2025-04-21 14:08:30.923489] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=47] LogLoopThread round_cost_time(us)(round_cost_time=31) [2025-04-21 14:08:30.924720] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:30.934423] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:30.944131] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:30.944216] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=76] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:30.955798] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=44] current monitor number(seq_=-1) [2025-04-21 14:08:30.970743] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:30.970890] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=87] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:30.970935] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:30.970991] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:30.971038] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:30.972604] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:30.972635] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:30.972655] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=83] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1760, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:30.972696] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:30.972710] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:30.972726] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1883, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:30.972746] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1853, avg_log_submit_to_slide_time=1870) [2025-04-21 14:08:30.972805] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:30.972830] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1923, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:30.972846] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:30.972886] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:31.001803] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0049-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:31.004322] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0049-0-0] [lt=55][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254916554628, cache_obj->added_lc()=false, cache_obj->get_object_id()=647, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:31.005785] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:31.005835] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=48] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:31.005832] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB1-0-0] [lt=51] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:31.005911] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB1-0-0] [lt=73] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:31.016969] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7775) [2025-04-21 14:08:31.027307] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=20] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:31.027452] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=48] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:31.032464] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:31.034495] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.038208] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=33] === Run print tenant memory usage task === [2025-04-21 14:08:31.038285] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=38] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 134,627,328 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 776,400,896 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,711,038,122 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,072,775,168 max_mem_memstore_can_get_now= 2,463,023,104 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,711,038,122 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,563,500 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 543,141,888 max_mem_memstore_can_get_now= 362,817,516 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,711,038,122 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,944,860 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 641,425,408 max_mem_memstore_can_get_now= 314,724,314 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:08:31.038375] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,180,355,584 total_hold= 3,351,248,896 used= 3,098,361,856 freelists_hold= 81,993,728 total_maps= 1,203 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,866,603,520 divisive_memory_used= 134,627,328 virtual_memory_used= 4,555,227,136 [CHUNK_MGR] 2 MB_CACHE: hold= 33,554,432 free= 16 pushes= 309,648 pops= 309,632 maps= 1,069 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 99 pops= 97 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:08:31.038425] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:08:31.049088] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:31.049266] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=118] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:31.049312] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=43] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=158, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:31.049420] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=39] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:31.049517] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=49] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:31.049551] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=9, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:31.053026] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215701050285, end_time=1745215711053022, dag_status={}) [2025-04-21 14:08:31.053083] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=53] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053143] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053164] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053185] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053204] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053223] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053260] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:31.053278] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053299] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053320] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053361] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053441] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053480] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053499] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053519] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053538] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053558] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053577] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053637] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053656] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053676] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053696] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053753] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053774] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053793] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053813] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053832] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053851] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053873] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053892] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053911] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053930] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053970] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.053990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054009] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054048] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054071] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054091] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054111] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054130] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054150] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054170] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054190] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054210] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054230] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054249] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054308] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054349] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054363] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054440] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054496] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054535] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054573] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054592] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054631] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:31.054651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:31.054671] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:31.054704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=32] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:31.054722] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:31.054740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:31.054757] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:31.054774] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:31.054802] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=28] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:31.054814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:31.054826] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:31.054847] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:31.056069] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD8F-0-0] [lt=49] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:08:31.064867] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:31.064920] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.066674] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:31.097387] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:31.097450] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=59] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:31.097472] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:31.097498] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:31.100719] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:31.101025] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=301] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:31.105629] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:31.107748] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9A-0-0] [lt=44] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=90) [2025-04-21 14:08:31.107988] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215711107590000, start_id=1745215711107590000, end_id=1745215711107590001) [2025-04-21 14:08:31.108720] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=54] success to update min reserved snapshot(reserved_snapshot=1745213901156150000, duration=1800, snapshot_gc_ts=1745215701156150000) [2025-04-21 14:08:31.112466] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8733806, this={dio_aligned_buf:{buf_write_offset:1246, buf_padding_size:2850, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2681, truncate_used_ts:1118}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8732672, buf_len=112, total_write_size=13172, total_write_size_after_dio=413696, ob_pwrite_used_ts=199778, count=98, each_pwrite_cost=2038) [2025-04-21 14:08:31.112736] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=59] update reserved snapshot finished(cost_ts=4020, reserved_snapshot=1745213901156150000) [2025-04-21 14:08:31.125306] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:31.134571] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.149163] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=43] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:08:31.150505] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=42] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:08:31.150549] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=40] no transfer partition job [2025-04-21 14:08:31.150577] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=23] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:08:31.153154] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=27] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:08:31.153213] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=45] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:08:31.153257] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD8F-0-0] [lt=36] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:08:31.177988] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:31.204755] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE0-0-0] [lt=23] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:31.204811] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE0-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:31.216524] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=93] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:31.216584] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8291, avg_group_log_size=637) [2025-04-21 14:08:31.218339] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:31.234650] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.239648] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB6-0-0] [lt=44] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:31.239732] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB6-0-0] [lt=72] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=88) [2025-04-21 14:08:31.259120] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE20-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:31.259190] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE20-0-0] [lt=67] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:31.260287] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:31.260347] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:31.260550] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:31.260744] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:31.260833] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:20, schedule:44, submit:9, rt:1244, total:1318) [2025-04-21 14:08:31.260911] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:31.260971] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:20, schedule:44, submit:9, device:1244, total:1318) [2025-04-21 14:08:31.261051] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:31.261123] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:990, total:1005) [2025-04-21 14:08:31.261199] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:31.261237] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:990, total:1005) [2025-04-21 14:08:31.261304] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:31.261332] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:31.266848] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=90] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:31.293699] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:31.293789] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=69] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:31.295347] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1444, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:31.295404] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:31.295449] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:31.295514] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=17, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:31.295540] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1600, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:31.295561] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1549, avg_log_submit_to_slide_time=1571) [2025-04-21 14:08:31.295597] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=60, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:31.300276] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:31.301508] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:31.301609] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215711165280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:31.318276] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=69] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215710672238004, v:0}, base_version={val:1745215710672238001, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215710672238004, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215711318248, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:31.319937] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF5C-0-0] [lt=79] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:31.320235] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] submit log success(service_type_=0, last_id=1745215727945792000, limited_id=1745215727945792000) [2025-04-21 14:08:31.320265] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] submit log with lock success(service_type_=0, last_id=1745215727945792000, limited_id=1745215727945792000) [2025-04-21 14:08:31.322010] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=55] update id meta(ret=0, service_type=0, limited_id=1745215727945792000, latest_scn={val:1745215711319320001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:31.322101] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=89] handle submit callback(service_type_=0, success=true, used_ts=1867, log_ts={val:1745215711319320001, v:0}, limited_id=1745215727945792000) [2025-04-21 14:08:31.322121] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:31.322148] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=26] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:31.323518] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215711322524000, start_id=1745215711322524000, end_id=1745215711322524001) [2025-04-21 14:08:31.323669] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=13] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215620564480, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:31.325860] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=87] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:31.334739] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.335209] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=11000000, clean_num=200000) [2025-04-21 14:08:31.365288] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:31.365372] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.371020] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:08:31.371094] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2449) [2025-04-21 14:08:31.371131] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:31.372863] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1332) [2025-04-21 14:08:31.406729] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=72][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:31.416651] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1745215711415961000, start_id=1745215711415961000, end_id=1745215711415961001) [2025-04-21 14:08:31.418526] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1618, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:31.418573] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8419) [2025-04-21 14:08:31.418604] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:31.418652] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8419) [2025-04-21 14:08:31.418714] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:31.418735] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1867, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:31.418754] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=124, avg_log_gen_to_submit_time=142, avg_log_submit_to_flush_time=1706, avg_log_submit_to_slide_time=1725) [2025-04-21 14:08:31.418830] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=56] gc stale ls task succ [2025-04-21 14:08:31.418835] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8419, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:31.419353] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=19] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:08:31.419437] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=74] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:08:31.419455] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:08:31.419491] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=32] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:31.422224] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=40] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:08:31.423880] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=39] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:08:31.425363] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=39] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:08:31.425403] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:08:31.426732] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:08:31.426837] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:31.426863] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=24] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:31.428071] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:31.431214] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=22] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:08:31.432691] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:08:31.432730] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:08:31.434060] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=20] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:31.434178] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:31.434207] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:31.434834] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.438525] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=22] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:08:31.440012] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=31] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:08:31.440051] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:08:31.441388] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:31.441487] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=31] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:31.441516] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=28] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:31.441551] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=21] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:31.441612] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=54] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:08:31.441636] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=21] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:31.441668] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:08:31.441700] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=31] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:08:31.441721] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=16] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:08:31.441738] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=15] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:31.441763] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:31.441785] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:08:31.441804] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=14] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:08:31.441816] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=11] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:31.441841] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:31.441862] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:08:31.443067] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:31.443109] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=39] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:31.443129] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=19] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:31.443165] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=16] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:08:31.443188] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=22] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:08:31.443207] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=18] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:08:31.443230] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=19] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:08:31.443256] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD91-0-0] [lt=25] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:08:31.444312] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:31.444364] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.472008] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5100000, replace_num=100000) [2025-04-21 14:08:31.472100] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=90] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:31.474647] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.474727] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.474771] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.475265] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.495402] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:08:31.495556] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=100] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:31.507468] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215711507463, bytes: 4374154, bw: 0.013462 MB/s, add_ts: 1007610, add_bytes: 14223 [2025-04-21 14:08:31.520428] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:31.522225] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=39] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215711165280001, v:0}, new_max_version={val:1745215711165280001, v:0}, last_min_version={val:1745215710672238004, v:0}, last_max_version={val:1745215710672238004, v:0}, total_time_us=3764, delta_us=356941) [2025-04-21 14:08:31.522259] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=117] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215711319320000, v:0}, min_version={val:1745215711319320000, v:0}, max_version={val:1745215711319320000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:31.529814] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDB9-0-0] [lt=32] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:31.530242] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:31.531474] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:31.531570] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215705554947000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:31.534911] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.535741] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:31.565090] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:31.565169] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.566747] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1745215711566741, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2025-04-21 14:08:31.570151] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:31.572948] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2571) [2025-04-21 14:08:31.577039] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:31.577094] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:31.577118] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:31.577147] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:31.577172] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254916127301, flush_io_finished_ret_:0, flush_io_finished_round_:103, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:31.589751] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=68] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:31.601977] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:31.602026] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:31.603701] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:31.603740] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:31.634996] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.642843] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF7A-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:31.646306] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215711646236000, start_id=1745215711646236000, end_id=1745215711646236001) [2025-04-21 14:08:31.648805] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF7E-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:31.672244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:31.674300] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1745215711674268000, start_id=1745215711674268000, end_id=1745215711674268001) [2025-04-21 14:08:31.674369] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:31.674629] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215711674613], gts:1745215711674268000, latest_srr:[mts=1745215711674613]}) [2025-04-21 14:08:31.695470] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=60] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695493] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695536] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695573] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695596] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695628] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.695810] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.696124] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.696212] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.696276] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.696565] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:31.735077] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.736307] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=97] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:31.741077] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3993, offset=54270}, end_cursor:ObLogCursor{file_id=3, log_id=3994, offset=54576}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77430050, len:3074, log_data_len:306, seq:3993, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:31.741459] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE45-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:31.741539] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE45-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215711646236000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215711646236000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:31.748461] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3994, offset=54576}, end_cursor:ObLogCursor{file_id=3, log_id=3995, offset=54873}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77434050, len:2768, log_data_len:297, seq:3994, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:31.749808] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE45-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:31.749880] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE45-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215711646236000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215711646236000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:31.786488] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:31.807846] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:08:31.808008] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9B-0-0] [lt=75] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:31.808197] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9B-0-0] [lt=179] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:31.811149] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=33] ====== check clog disk timer task ====== [2025-04-21 14:08:31.811225] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=66] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:31.818871] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:08:31.822040] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:31.822091] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:31.822109] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:31.822132] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:31.822151] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254916372276, flush_io_finished_ret_:0, flush_io_finished_round_:103, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:31.827239] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:08:31.828056] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=71] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:31.835108] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:31.835150] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.836085] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:31.836156] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=70] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:31.836224] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:31.836330] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=101] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:31.836376] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:31.836403] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215708564600001, v:0}) [2025-04-21 14:08:31.836422] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:31.836441] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:31.836464] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:31.836497] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:31.836520] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:31.836552] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:31.836584] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:31.836604] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:31.841074] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1F-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:31.841137] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE1F-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:31.842052] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=42] clear dtl interm result cost(us)(clear_cost=2963, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:31.851663] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:31.865488] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:31.865550] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.872430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=88] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:31.872989] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1567, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:31.873102] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:31.888624] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:31.888782] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=52][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:31.890411] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=31] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215711888815) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215711888815) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:31.894201] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:31.894266] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:08:31.915074] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=78] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:31.935224] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:31.936823] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:31.944512] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:31.944568] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:31.971453] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:31.971537] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:31.971569] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1710, avg_group_log_size=190) [2025-04-21 14:08:31.971604] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1710) [2025-04-21 14:08:31.971633] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:31.973045] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=69] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1577, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:31.973102] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:31.973134] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:31.973149] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2449) [2025-04-21 14:08:31.973203] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:31.973232] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1824, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:31.973255] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=102, avg_log_gen_to_submit_time=132, avg_log_submit_to_flush_time=1695, avg_log_submit_to_slide_time=1716) [2025-04-21 14:08:31.973289] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:31.973318] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1710) [2025-04-21 14:08:31.973350] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:31.973369] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1695, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:31.973387] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1681) [2025-04-21 14:08:31.973429] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=90] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:31.986720] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=47] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:08:32.009284] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004A-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:32.012526] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004A-0-0] [lt=60][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254917562833, cache_obj->added_lc()=false, cache_obj->get_object_id()=648, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:32.032592] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:32.035292] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.065314] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:32.065399] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=76] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.072601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:32.073526] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1832, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:32.094291] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=37] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:32.094348] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=55] try gc retain ctx [2025-04-21 14:08:32.094365] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:08:32.094418] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215711920278000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215701912141001, v:0}, keep_alive_scn_:{val:1745215706916796001, v:0}, update_ts_:1745215712093454}) [2025-04-21 14:08:32.095457] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:32.115725] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215712016513000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215712115651}, version_delta=99207) [2025-04-21 14:08:32.119449] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215711920278000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199158, in_cluster_service=true, cluster_version={val:1745215711720340000, v:0}, min_cluster_version={val:1745215711720340000, v:0}, max_cluster_version={val:1745215711720340000, v:0}, get_cluster_version_err=0, cluster_version_delta=399096, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=930, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=49649573, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:32.120940] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9006) [2025-04-21 14:08:32.135386] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.137393] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:32.174923] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=34] ts response task statistics(alloc_count=2238, free_count=1118) [2025-04-21 14:08:32.174996] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=57] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=400, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:32.206666] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE1-0-0] [lt=25] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:32.206739] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE1-0-0] [lt=70] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:32.217422] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:32.217480] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7900, avg_group_log_size=607) [2025-04-21 14:08:32.219157] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:32.235473] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.261031] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE22-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:32.261108] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE22-0-0] [lt=73] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:32.262342] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:32.262404] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:32.262582] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:32.262781] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:32.262869] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:16, schedule:42, submit:10, rt:1336, total:1404) [2025-04-21 14:08:32.262948] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:32.263009] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:16, schedule:42, submit:10, device:1336, total:1404) [2025-04-21 14:08:32.263067] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:32.263142] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:753, total:773) [2025-04-21 14:08:32.263225] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:32.263266] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:753, total:773) [2025-04-21 14:08:32.263334] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:32.263363] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:32.272744] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:32.294525] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=107] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:32.294608] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:32.296035] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1383, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:32.296108] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:32.296138] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3525) [2025-04-21 14:08:32.296207] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:32.296235] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1534, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:32.296259] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1487, avg_log_submit_to_slide_time=1508) [2025-04-21 14:08:32.296300] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=57, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:32.321064] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF61-0-0] [lt=42] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:32.335556] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.337963] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:32.365668] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:32.365751] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.371810] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:32.371889] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:32.371926] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:32.373788] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1720) [2025-04-21 14:08:32.401308] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:32.401371] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:32.418909] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:32.419385] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1547, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:32.419438] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7772) [2025-04-21 14:08:32.419484] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:32.419519] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7772) [2025-04-21 14:08:32.419588] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:32.419617] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1667, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:32.419639] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1623, avg_log_submit_to_slide_time=1644) [2025-04-21 14:08:32.419721] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7772, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:32.422589] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=51] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:32.426190] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=36] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:32.426243] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:32.426271] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:32.426299] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:32.426325] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254916976409, flush_io_finished_ret_:0, flush_io_finished_round_:104, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:32.428229] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:32.435646] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.444730] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:32.444801] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.472911] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:32.474880] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=52] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.474947] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.474984] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.475376] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.480189] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:08:32.496261] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3525) [2025-04-21 14:08:32.496442] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3525, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:32.515093] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1745215712515088, bytes: 4386926, bw: 0.012088 MB/s, add_ts: 1007625, add_bytes: 12772 [2025-04-21 14:08:32.515449] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=86] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:32.520894] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:32.521262] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=90] get number(ret=0, service_type_=0, range=1, base_id=1745215712520484000, start_id=1745215712520484000, end_id=1745215712520484001) [2025-04-21 14:08:32.522850] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215712174736000, v:0}, new_max_version={val:1745215712174736000, v:0}, last_min_version={val:1745215711674268002, v:0}, last_max_version={val:1745215711674268002, v:0}, total_time_us=3577, delta_us=348111) [2025-04-21 14:08:32.522902] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215712174736000, v:0}, min_version={val:1745215712174736000, v:0}, max_version={val:1745215712174736000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:32.522934] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215620564480, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:32.535736] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.538510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=86] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:32.565552] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:32.565639] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.565609] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=32] ====== check clog disk timer task ====== [2025-04-21 14:08:32.565678] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=55] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:32.570239] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=59] gc stale ls task succ [2025-04-21 14:08:32.570753] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004C-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:32.573173] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004C-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254918123481, cache_obj->added_lc()=false, cache_obj->get_object_id()=649, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:32.574197] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:32.574370] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215712574365, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007624, add_bytes: 0 [2025-04-21 14:08:32.574675] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004F-0-0] [lt=42][errcode=-4201] hashtable not init [2025-04-21 14:08:32.574723] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF004F-0-0] [lt=45] get cursor info failed(cursor_id=34, get_sessid()=3221487630) [2025-04-21 14:08:32.574874] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215712574210000, start_id=1745215712574210000, end_id=1745215712574210001) [2025-04-21 14:08:32.589991] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=81] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:32.599323] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=22] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:32.599391] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=51] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=21) [2025-04-21 14:08:32.602151] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:32.602195] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:32.604057] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:32.604095] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:32.606980] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=71] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:32.635813] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.657115] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:32.658363] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=49] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:32.658464] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215708742072000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:32.664942] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=35] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25943065}, readable_log_tail:{lsn:25943065}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41161703, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:32.665092] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=148] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:08:32.665137] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=20] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:32.673128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=117] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:32.673834] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=28, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:32.673882] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=47] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=2420, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:32.673898] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:32.673912] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=-587, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:32.673926] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=1861, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:32.675471] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:32.675530] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=44] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215712675516], gts:1745215712675364000, latest_srr:[mts=1745215712675516]}) [2025-04-21 14:08:32.679599] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] [COMPACTION DAG STATUS] (start_time=1745215702676974, end_time=1745215712679596, dag_status={}) [2025-04-21 14:08:32.679648] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=45] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679670] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679684] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679698] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679722] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679736] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679776] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679796] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:32.679809] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679840] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679854] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679895] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679916] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679936] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.679993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680014] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680034] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680092] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680142] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680162] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680187] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680212] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680234] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680280] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680302] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680343] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680362] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680402] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680442] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680464] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680484] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680505] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680547] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680607] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680626] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680646] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680666] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680687] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680707] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680727] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680767] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680807] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680826] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680846] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680887] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680929] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680949] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680963] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.680984] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681037] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681059] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681079] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681142] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681163] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681183] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681203] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681223] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681268] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:32.681290] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:32.681310] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:32.681324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:32.681335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:32.681347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:32.681364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:32.681381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:32.681398] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:32.681415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:32.681432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:32.681451] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:32.681535] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] ====== tenant freeze timer task ====== [2025-04-21 14:08:32.681576] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=31] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:32.681626] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:32.688167] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=85] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585092812800, fast_delete_log_mode=false) [2025-04-21 14:08:32.695044] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695315] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695323] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695377] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695414] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695437] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695488] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695545] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695816] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.695980] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] Garbage Collector is running(seq_=11, gc_interval=10000000) [2025-04-21 14:08:32.696050] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=34] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:32.696081] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] gc_check_member_list_ cost time(ret=0, time_us=65) [2025-04-21 14:08:32.696105] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:32.696211] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.696446] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:32.697428] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=16] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:32.697473] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=38] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:32.697498] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=27) [2025-04-21 14:08:32.697518] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyHandler start process [2025-04-21 14:08:32.697537] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:08:32.697569] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:08:32.735906] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.739078] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:32.756166] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3995, offset=54873}, end_cursor:ObLogCursor{file_id=3, log_id=3996, offset=55179}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77438050, len:2471, log_data_len:306, seq:3995, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:32.756528] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE46-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:32.756609] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE46-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215712174736004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215712174736004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:32.759769] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE46-0-0] [lt=14] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215711646236000, v:0}, new_replayable_scn={val:1745215711646236000, v:0}, new_readable_scn={val:1745215711646236000, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215710172577004, replayable_scn:1745215710172577004, readable_scn:1745215710172577004, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:08:32.763201] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3996, offset=55179}, end_cursor:ObLogCursor{file_id=3, log_id=3997, offset=55476}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7743c050, len:2165, log_data_len:297, seq:3996, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:32.763508] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE46-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:32.763569] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE46-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215712174736004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215712174736004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:32.768138] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15701, max_lsn:25945538, max_scn:{val:1745215712764463000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:25945538}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:25944788}, last_submit_end_lsn:{lsn:25945538}, last_submit_log_id:15701, last_submit_log_pid:3, max_flushed_lsn:{lsn:25944788}, max_flushed_end_lsn:{lsn:25945538}, max_flushed_log_pid:3, committed_end_lsn:{lsn:25945538}, last_slide_log_id:15701, last_slide_scn:{val:1745215712764463000, v:0}, last_slide_lsn:{lsn:25944788}, last_slide_end_lsn:{lsn:25945538}, last_slide_log_pid:3, last_slide_log_accum_checksum:1758162161, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15702, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:25945538}, readable_log_tail:{lsn:25945538}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41159230, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:08:32.768386] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=242] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215712766735, last_flushed_end_lsn:{lsn:25945538}}]) [2025-04-21 14:08:32.768412] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15702, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215712766735, last_flushed_end_lsn:{lsn:25945538}}]) [2025-04-21 14:08:32.786623] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:32.789148] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=59] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:32.818955] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:32.822268] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:32.822346] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=67] temporary file module use no blocks [2025-04-21 14:08:32.822366] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:32.822388] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:32.822407] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254917372504, flush_io_finished_ret_:0, flush_io_finished_round_:104, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:32.828242] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:32.836000] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.842914] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE20-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:32.842981] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE20-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:32.844206] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=54] BlockGCTimerTask success(ret=0, cost_time_us=38, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:32.865876] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:32.865957] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.868239] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=329) [2025-04-21 14:08:32.873276] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:32.874020] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1657, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:32.874121] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:32.895064] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4085, avg_group_log_size=371) [2025-04-21 14:08:32.895124] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4085) [2025-04-21 14:08:32.923279] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=42] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:32.936084] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:32.939598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:32.944890] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:32.944962] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:32.956069] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=82] current monitor number(seq_=-1) [2025-04-21 14:08:32.972272] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:32.972369] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:32.972403] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:32.972441] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:32.972473] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:32.974127] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1740, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:32.974195] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:32.974249] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:32.974257] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:32.974322] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:32.974350] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1885, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:32.974371] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1837, avg_log_submit_to_slide_time=1853) [2025-04-21 14:08:32.974398] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:32.974424] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:32.974455] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:32.974476] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1811, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:32.974495] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1786, avg_log_submit_to_slide_time=1800) [2025-04-21 14:08:32.974553] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:33.006647] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:33.006711] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=63] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:33.006707] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB2-0-0] [lt=36] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:33.006761] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB2-0-0] [lt=49] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:33.016884] WDIAG begin (ob_hashtable.h:954) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD89-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:33.019603] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD89-0-0] [lt=48][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254918569909, cache_obj->added_lc()=false, cache_obj->get_object_id()=650, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:33.032738] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=48] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:33.036167] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.065785] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:33.065864] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.073430] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:33.074218] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:33.121725] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1745215713121328000, start_id=1745215713121328000, end_id=1745215713121328001) [2025-04-21 14:08:33.121853] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:08:33.136250] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.140123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:33.176063] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215713176026], gts:1745215713175128000, latest_srr:[mts=1745215713176026]}) [2025-04-21 14:08:33.187769] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:33.208528] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE2-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:33.208586] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE2-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:33.218452] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:33.218525] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7772, avg_group_log_size=647) [2025-04-21 14:08:33.220346] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:33.236339] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.240430] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB7-0-0] [lt=70] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:33.240497] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB7-0-0] [lt=56] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=71) [2025-04-21 14:08:33.263010] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE23-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:33.263085] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE23-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:33.264424] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:33.264508] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:33.264703] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:33.264901] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:33.264991] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:16, schedule:27, submit:8, rt:1355, total:1407) [2025-04-21 14:08:33.265095] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:33.265167] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:16, schedule:27, submit:8, device:1355, total:1407) [2025-04-21 14:08:33.265229] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:33.265303] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:936, total:958) [2025-04-21 14:08:33.265391] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:33.265433] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:936, total:958) [2025-04-21 14:08:33.265488] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:33.265516] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:33.273594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:33.295382] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:33.295454] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:33.296753] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1414, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:33.296811] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:33.296840] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4094) [2025-04-21 14:08:33.296906] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:33.296932] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1568, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:33.296955] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1518, avg_log_submit_to_slide_time=1540) [2025-04-21 14:08:33.296991] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:33.321758] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF66-0-0] [lt=34] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:33.336425] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.340654] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:33.349914] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=11200000, clean_num=200000) [2025-04-21 14:08:33.366070] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:33.366141] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.372554] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:33.372610] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:33.372638] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:33.374131] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:33.419004] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:08:33.419958] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1577, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:33.420012] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7772) [2025-04-21 14:08:33.420059] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:33.420090] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7772) [2025-04-21 14:08:33.420151] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:33.420173] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1726, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:33.420187] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1681, avg_log_submit_to_slide_time=1701) [2025-04-21 14:08:33.420268] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7772, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:33.428387] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:33.436513] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.445127] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:33.445209] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.473743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:33.475502] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.475656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.475727] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.475809] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.497061] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4094) [2025-04-21 14:08:33.497258] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4094, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:33.521842] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:33.522710] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1745215713522702, bytes: 4401149, bw: 0.013462 MB/s, add_ts: 1007614, add_bytes: 14223 [2025-04-21 14:08:33.523971] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215713321757000, v:0}, new_max_version={val:1745215713321757000, v:0}, last_min_version={val:1745215713121328000, v:0}, last_max_version={val:1745215713121328000, v:0}, total_time_us=3275, delta_us=202211) [2025-04-21 14:08:33.524027] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215713321757000, v:0}, min_version={val:1745215713321757000, v:0}, max_version={val:1745215713321757000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:33.535491] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBA-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:33.536592] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.550572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:33.551232] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620299][T1002_ObXAHbWor][T1002][Y0-0000000000000000-0-0] [lt=48] XA scheduler heartbeat task statistics(avg_time=3) [2025-04-21 14:08:33.562647] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:08:33.562900] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9A-0-0] [lt=113] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215713176196002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:33.563100] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9A-0-0] [lt=147] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:33.563177] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9A-0-0] [lt=73] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:33.566033] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:33.566134] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=90] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.570338] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:08:33.571178] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0052-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:33.573898] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0052-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254919124205, cache_obj->added_lc()=false, cache_obj->get_object_id()=651, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:33.575755] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:33.577424] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=51] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:33.577493] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:08:33.577532] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:33.577564] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:33.577620] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=53] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254918127637, flush_io_finished_ret_:0, flush_io_finished_round_:105, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:33.581972] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1745215713581967, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2025-04-21 14:08:33.590212] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=75] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:33.592422] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:33.592565] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:08:33.601964] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:33.602004] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:33.603979] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:33.604019] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:33.634236] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:33.635331] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=57] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:33.635401] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:33.635480] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:33.635595] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=110] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:33.635624] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:33.635647] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=0, rec_log_ts={val:1745215704165731001, v:0}) [2025-04-21 14:08:33.635662] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:33.635684] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:33.635723] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=32] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:33.635747] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:33.635786] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:33.635825] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:33.636673] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.636839] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:33.636886] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=47] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:33.636945] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:33.637041] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=93] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:33.637062] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:33.637081] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=14] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:33.637107] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:33.637130] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:33.637154] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:33.637183] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:33.637202] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:33.667349] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=69] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:33.674374] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=27] [APPLY STAT CB APPEND COST TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=71, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:33.674461] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=86] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=2808, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:33.674479] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:33.674492] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=-568, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:33.674505] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=2311, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:33.676612] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=83] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:33.679147] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5200000, replace_num=100000) [2025-04-21 14:08:33.679198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:33.695316] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695375] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695413] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695409] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695400] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695515] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695607] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695791] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.695817] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.696156] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.696302] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:33.724712] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDDB-0-0] [lt=24] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:33.725374] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215620564480, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:33.736813] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:33.736841] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:33.736857] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.751114] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:33.762267] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9C-0-0] [lt=64] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:33.772792] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:33.772850] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=55] try gc retain ctx [2025-04-21 14:08:33.772867] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:08:33.772924] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] finish update min start scn(max_decided_scn={val:1745215713176196004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215703664829000, v:0}, keep_alive_scn_:{val:1745215708670854000, v:0}, update_ts_:1745215713771914}) [2025-04-21 14:08:33.774070] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215720473222000, latest_log_ts:{val:1745215704165731001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:33.774291] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=119] finish update min start scn(max_decided_scn={val:1745215713176196004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215703664829000, v:0}, keep_alive_scn_:{val:1745215708670854000, v:0}, update_ts_:1745215713774055}) [2025-04-21 14:08:33.775418] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215710172577004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:33.786744] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:33.788302] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDDD-0-0] [lt=58] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:33.811333] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:33.811380] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:33.819037] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:33.822524] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:33.822553] INFO [STORAGE.REDO] write_logs (ob_storage_log_writer.cpp:512) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Slow write(duration=54658, write_len=4096) [2025-04-21 14:08:33.822577] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:33.822597] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:33.822593] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3997, offset=55476}, end_cursor:ObLogCursor{file_id=3, log_id=3998, offset=55782}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77440050, len:1868, log_data_len:306, seq:3997, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:33.822624] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:33.822647] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254918372764, flush_io_finished_ret_:0, flush_io_finished_round_:105, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:33.822994] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE47-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:33.823061] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE47-0-0] [lt=55] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215713176196004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215713176196004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:33.823389] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8733372}], scn_array=[cnt:1, {val:1745215713676177000, v:0}], curr_size=113, accum_size=479, time_cost=47815) [2025-04-21 14:08:33.823627] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17321725}], scn_array=[cnt:1, {val:1745215713676177000, v:0}], curr_size=113, accum_size=235, time_cost=49350) [2025-04-21 14:08:33.828403] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:33.828810] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=74] ====== tenant freeze timer task ====== [2025-04-21 14:08:33.829598] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=56] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3998, offset=55782}, end_cursor:ObLogCursor{file_id=3, log_id=3999, offset=56079}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77444050, len:1562, log_data_len:297, seq:3998, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:33.829927] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE47-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:33.830045] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE47-0-0] [lt=100] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215713676177000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215713676177000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:33.836834] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.844703] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE21-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:33.844768] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE21-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:33.860110] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=95] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:33.866260] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:33.866325] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.879313] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=31] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:33.889198] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17321838}], scn_array=[cnt:1, {val:1745215713676177001, v:0}], curr_size=122, accum_size=357, time_cost=16246) [2025-04-21 14:08:33.889276] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7873, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:33.889335] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8733485}], scn_array=[cnt:1, {val:1745215713676177001, v:0}], curr_size=122, accum_size=601, time_cost=16288) [2025-04-21 14:08:33.889361] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:33.889418] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:33.891442] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1745215713891213000, start_id=1745215713891213000, end_id=1745215713891213001) [2025-04-21 14:08:33.895871] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:33.895922] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:33.907446] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDC8-0-0] [lt=40] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:33.908644] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=55][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:33.913692] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=46] ls blacklist refresh finish(cost_time=9295) [2025-04-21 14:08:33.913930] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=54] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:33.915524] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDDF-0-0] [lt=48] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:33.920438] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215713176196004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=744229, in_cluster_service=true, cluster_version={val:1745215713176196002, v:0}, min_cluster_version={val:1745215713176196002, v:0}, max_cluster_version={val:1745215713176196002, v:0}, get_cluster_version_err=0, cluster_version_delta=744229, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=922, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=44796161, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:33.936913] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:33.945351] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:33.945412] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:33.951728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:33.973030] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=92] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:33.973159] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:33.973196] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:33.973230] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:33.973253] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:33.974602] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7996, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:33.974659] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:33.974661] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:33.974769] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:33.974809] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8168, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:33.974841] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:33.974880] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:33.974900] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7982, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:34.020595] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=38] [APPLY STAT CB APPEND COST TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:34.020646] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=49] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=1923, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:34.020663] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:34.020678] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=-460, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:34.020711] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=32] [APPLY STAT CB TOTAL TIME](cur_stat_count=40, stat_interval=5000000, avg (count/cost)=1525, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:34.021164] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] get_max_applied_scn(scn={val:1745215713922376000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65696163}, palf_committed_end_scn_:{val:1745215713922376000, v:0}, last_check_scn_:{val:1745215713922376000, v:0}, max_applied_cb_scn_:{val:1745215713922376000, v:0}}) [2025-04-21 14:08:34.021222] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65696163}, readable_log_tail:{lsn:65696163}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1408605, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:34.024141] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0054-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:34.027033] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0054-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254919577337, cache_obj->added_lc()=false, cache_obj->get_object_id()=652, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:34.029209] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=54] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:34.032879] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=52] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:34.037027] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.049757] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:34.049886] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=75] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:34.049914] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=164, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:34.050000] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:34.050064] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:34.050081] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=10, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:34.053230] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:34.053284] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=50] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:34.053309] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:34.053335] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:34.056708] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:34.057155] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=442] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:34.066254] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:34.066324] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.074609] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:08:34.074678] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=37, avg_log_submit_to_flush_time=7506, avg_log_submit_to_slide_time=7530) [2025-04-21 14:08:34.074740] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:08:34.074770] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=7377, avg_log_submit_to_slide_time=7391) [2025-04-21 14:08:34.074826] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:34.079457] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:34.117226] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] get_max_applied_scn(scn={val:1745215714018093000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25955624}, palf_committed_end_scn_:{val:1745215714018093000, v:0}, last_check_scn_:{val:1745215714018093000, v:0}, max_applied_cb_scn_:{val:1745215714018093000, v:0}}) [2025-04-21 14:08:34.117333] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=92] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25955624}, readable_log_tail:{lsn:25955624}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41149144, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:34.122636] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8319) [2025-04-21 14:08:34.137093] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.152286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:34.174924] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:34.177452] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=59] submit log success(service_type_=0, last_id=1745215730473222000, limited_id=1745215730473222000) [2025-04-21 14:08:34.177496] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=43] submit log with lock success(service_type_=0, last_id=1745215730473222000, limited_id=1745215730473222000) [2025-04-21 14:08:34.177527] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=378, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:34.178846] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=20] update id meta(ret=0, service_type=0, limited_id=1745215730473222000, latest_scn={val:1745215714176938001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215711646236000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:34.178949] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=100] handle submit callback(service_type_=0, success=true, used_ts=1497, log_ts={val:1745215714176938001, v:0}, limited_id=1745215730473222000) [2025-04-21 14:08:34.178970] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:34.178985] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF7D-0-0] [lt=14] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:34.210564] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE3-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:34.210626] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE3-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:34.219124] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=187] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:34.219195] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8319, avg_group_log_size=639) [2025-04-21 14:08:34.220756] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=41] get_max_applied_scn(scn={val:1745215713676177003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17322454}, palf_committed_end_scn_:{val:1745215714176938001, v:0}, last_check_scn_:{val:1745215714176938001, v:0}, max_applied_cb_scn_:{val:1745215713676177003, v:0}}) [2025-04-21 14:08:34.220870] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:34.220822] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=55] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17322454}, readable_log_tail:{lsn:17322454}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49782314, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:34.237179] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.264359] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=96] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:34.265287] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE24-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:34.265361] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE24-0-0] [lt=70] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:34.266639] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:34.266725] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:34.266923] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:34.267131] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:34.267231] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:18, schedule:45, submit:10, rt:27869, total:27942) [2025-04-21 14:08:34.267317] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:34.267387] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:18, schedule:45, submit:10, device:27869, total:27942) [2025-04-21 14:08:34.267462] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:34.267539] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:945, total:966) [2025-04-21 14:08:34.267628] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:34.267673] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:945, total:966) [2025-04-21 14:08:34.267748] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:34.267781] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:34.278397] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=46] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:34.279600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:34.296239] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:34.296338] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=74] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:34.297676] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=74] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1860, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:34.297736] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:34.297790] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:34.297863] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:34.297889] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2030, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:34.297910] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1977, avg_log_submit_to_slide_time=1999) [2025-04-21 14:08:34.297947] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=87, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:34.306308] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=54] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:34.308361] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:34.309825] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=54] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:34.309942] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215711165280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:34.322290] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF6B-0-0] [lt=101] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:34.324382] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=69] get_max_applied_scn(scn={val:1745215713676177004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8734095}, palf_committed_end_scn_:{val:1745215714176938000, v:0}, last_check_scn_:{val:1745215714176938000, v:0}, max_applied_cb_scn_:{val:1745215713676177004, v:0}}) [2025-04-21 14:08:34.324449] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=58] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8734095}, readable_log_tail:{lsn:8734095}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58370673, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:34.337263] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.352815] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:34.366433] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:34.366482] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.373331] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:08:34.373398] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:08:34.373426] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:34.389926] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=36] clear dtl interm result cost(us)(clear_cost=9, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:34.398293] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=23] ====== traversal_flush timer task ====== [2025-04-21 14:08:34.398436] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9B-0-0] [lt=46] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215714218837000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:34.398585] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9B-0-0] [lt=142] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:34.399006] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:34.399070] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=50] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:34.399110] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=34] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=22) [2025-04-21 14:08:34.401526] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=35] ====== check clog disk timer task ====== [2025-04-21 14:08:34.401586] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:34.419070] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:08:34.426551] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:34.426603] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:34.426621] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:34.426649] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:34.426674] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254918976781, flush_io_finished_ret_:0, flush_io_finished_round_:106, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:34.428539] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:34.430336] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:34.431310] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:1, active_tx_count:1, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:34.431368] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=57] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:1745215714417930000, v:0}) [2025-04-21 14:08:34.431441] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:34.431543] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=97] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:34.431588] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:34.431613] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215711319320001, v:0}) [2025-04-21 14:08:34.431632] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:34.431650] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:34.431671] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:34.431701] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:34.431724] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:34.431754] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:34.431787] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:34.431806] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:34.437337] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.439676] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=98] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:34.445557] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:34.445617] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.449064] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] success to update min reserved snapshot(reserved_snapshot=1745213908742072000, duration=1800, snapshot_gc_ts=1745215708742072000) [2025-04-21 14:08:34.464867] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=51][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:34.465076] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=56][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:34.467059] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215714465120) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215714465120) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:34.475430] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.475503] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.475566] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.475716] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=61] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.479736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:34.480567] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=36] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:34.481979] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:08:34.523045] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=125] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:34.524791] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:34.530300] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=96] PNIO [ratelimit] time: 1745215714530294, bytes: 4413921, bw: 0.012089 MB/s, add_ts: 1007592, add_bytes: 12772 [2025-04-21 14:08:34.537417] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.539827] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:34.541751] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=63] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:34.541897] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=56] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215705554947000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:34.553343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:34.565781] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:34.565870] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=74] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:34.566461] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:34.566520] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.570405] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:08:34.577800] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=81] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:34.577883] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=72] temporary file module use no blocks [2025-04-21 14:08:34.577912] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:34.577950] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:34.577978] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254919128019, flush_io_finished_ret_:0, flush_io_finished_round_:106, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:34.589571] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215714589567, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2025-04-21 14:08:34.590388] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=47] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:34.602132] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:34.602175] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:34.603901] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:34.603939] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:34.607841] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=103] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:34.607906] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=62] try gc retain ctx [2025-04-21 14:08:34.607931] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=24] try to retry start_working [2025-04-21 14:08:34.607988] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=16] finish update min start scn(max_decided_scn={val:1745215714322263000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215704414040002, v:0}, keep_alive_scn_:{val:1745215709518602001, v:0}, update_ts_:1745215714607796}) [2025-04-21 14:08:34.609498] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=51] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:34.637489] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.652251] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=32] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:34.652326] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=55] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=20) [2025-04-21 14:08:34.653209] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=25] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:34.653294] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=63] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:34.653335] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=37] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:34.653358] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=20) [2025-04-21 14:08:34.677800] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:34.677877] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=390, get_gts_with_stc_cnt=61, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=59, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:34.678126] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=32] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215714678107], gts:1745215714677919000, latest_srr:[mts=1745215714678107]}) [2025-04-21 14:08:34.679867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:34.683179] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:08:34.683226] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:34.683274] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:34.688177] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=32] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:34.688227] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=36] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=22) [2025-04-21 14:08:34.691586] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:34.691634] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=37] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:34.691658] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=22) [2025-04-21 14:08:34.694798] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=59] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.694865] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.694955] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.695012] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.695049] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.695766] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.695877] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.696034] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.696078] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.696257] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.696514] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:34.737578] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.753906] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:34.786859] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:34.819123] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:34.822800] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=67] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:34.822866] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:08:34.822887] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:34.822918] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:34.822947] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254919373033, flush_io_finished_ret_:0, flush_io_finished_round_:106, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:34.828559] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:34.837653] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.846595] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE22-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:34.846667] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE22-0-0] [lt=69] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:34.847285] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:718) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=39] handle timeout(ret=0, *this={this:0x7f3c4dd773d0, ref:4, trans_id:{txid:2001677}, tenant_id:1001, is_exiting:false, trans_expired_time:1745215744522510, cluster_version:17180066817, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1745215714522976], ctx_create_time:1745215714522539}{self_ls_id:{id:1}, session_id:1, associated_session_id:1, part_trans_action:3, pending_write:0, 2pc_role:"UNKNOWN", ctx_tx_data_:{ctx_mgr_:0x7f3c3e604030, tx_data_guard_:{tx_data:{tx_id:{txid:2001677}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1745215714522539000, v:0}, start_scn:{val:1745215714522539000, v:0}, end_scn:{val:18446744073709551615, v:3}, op_guard:{tx_data_op_:null}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:915283846840378, replay_completeness_:1, upstream_state:"INIT", collected:[], rec_log_ts:{val:1745215714522539000, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, last_request_ts:1745215714522539, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745214049139168 max_table_version=1745214049139168 trans_version={val:1745215714522539000, v:0} commit_version={val:1745215714522539000, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001677} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:0, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,0,2,0,0,0)|]}} -{busy_cbs_cnt:1, oldest_busy_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, final_log_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, -{info_log_submitted:1 state_log_submitting:1 state_log_submitted:1 }-, -{downstream_state:"INIT", upstream:{id:-1}, participants:[{id:1}], redo_log_no:0, scheduler:"11.29.122.182:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:18446744073709551615, v:3}, max_appling_log_ts:{val:18446744073709551615, v:3}, max_applying_part_log_no:9223372036854775807, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], need_checksum:true, data_complete:false, is_dup_tx:false, exec_epoch:0, commit_parts:[{ls_id:{id:1}, exec_epoch:915283846840378, transfer_epoch:-1}], }- }-}, tx_expired=false, commit_expired=false, delay=100000) [2025-04-21 14:08:34.847472] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:721) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=185] trx is waiting log_cb(busy_cbs_.get_size()=1, busy_cbs_.get_first()={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, busy_cbs_.get_last()={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}) [2025-04-21 14:08:34.847526] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:718) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=46] handle timeout(ret=0, *this={this:0x7f3c4dd9d110, ref:4, trans_id:{txid:2001675}, tenant_id:1001, is_exiting:false, trans_expired_time:1745215744417911, cluster_version:17180066817, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1745215714418901], ctx_create_time:1745215714417930}{self_ls_id:{id:1}, session_id:1, associated_session_id:1, part_trans_action:3, pending_write:0, 2pc_role:"UNKNOWN", ctx_tx_data_:{ctx_mgr_:0x7f3c3e604030, tx_data_guard_:{tx_data:{tx_id:{txid:2001675}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1745215714417930000, v:0}, start_scn:{val:1745215714417930000, v:0}, end_scn:{val:18446744073709551615, v:3}, op_guard:{tx_data_op_:null}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:915283742815797, replay_completeness_:1, upstream_state:"INIT", collected:[], rec_log_ts:{val:1745215714417930000, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, last_request_ts:1745215714417930, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745214049139168 max_table_version=1745214049139168 trans_version={val:1745215714417930000, v:0} commit_version={val:1745215714417930000, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001675} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:0, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,0,2,0,0,0)|]}} -{busy_cbs_cnt:1, oldest_busy_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, final_log_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, -{info_log_submitted:1 state_log_submitting:1 state_log_submitted:1 }-, -{downstream_state:"INIT", upstream:{id:-1}, participants:[{id:1}], redo_log_no:0, scheduler:"11.29.122.182:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:18446744073709551615, v:3}, max_appling_log_ts:{val:18446744073709551615, v:3}, max_applying_part_log_no:9223372036854775807, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], need_checksum:true, data_complete:false, is_dup_tx:false, exec_epoch:0, commit_parts:[{ls_id:{id:1}, exec_epoch:915283742815797, transfer_epoch:-1}], }- }-}, tx_expired=false, commit_expired=false, delay=100000) [2025-04-21 14:08:34.847622] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:721) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=95] trx is waiting log_cb(busy_cbs_.get_size()=1, busy_cbs_.get_first()={ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, busy_cbs_.get_last()={ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}) [2025-04-21 14:08:34.866617] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:34.866670] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.880007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:34.884626] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:34.884666] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=37] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:34.884690] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:34.884711] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:34.887952] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:3, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:34.888656] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=700] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:34.937727] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:34.943117] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:34.945097] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1745215714944226000, start_id=1745215714944226000, end_id=1745215714944226001) [2025-04-21 14:08:34.945190] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2771) [2025-04-21 14:08:34.945759] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:34.945811] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:34.954388] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:34.956345] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=58] current monitor number(seq_=-1) [2025-04-21 14:08:34.964072] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:35.007453] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:35.007482] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB3-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:35.007498] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=44] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:35.007521] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB3-0-0] [lt=35] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:35.030495] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0056-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:35.032901] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0056-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254920583210, cache_obj->added_lc()=false, cache_obj->get_object_id()=653, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:35.032988] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:35.037807] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.042327] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=16) [2025-04-21 14:08:35.066608] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:35.066660] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.080148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:35.137891] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.147558] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:718) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=41] handle timeout(ret=0, *this={this:0x7f3c4dd773d0, ref:4, trans_id:{txid:2001677}, tenant_id:1001, is_exiting:false, trans_expired_time:1745215744522510, cluster_version:17180066817, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1745215714522976], ctx_create_time:1745215714522539}{self_ls_id:{id:1}, session_id:1, associated_session_id:1, part_trans_action:3, pending_write:0, 2pc_role:"UNKNOWN", ctx_tx_data_:{ctx_mgr_:0x7f3c3e604030, tx_data_guard_:{tx_data:{tx_id:{txid:2001677}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1745215714522539000, v:0}, start_scn:{val:1745215714522539000, v:0}, end_scn:{val:18446744073709551615, v:3}, op_guard:{tx_data_op_:null}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:915283846840378, replay_completeness_:1, upstream_state:"INIT", collected:[], rec_log_ts:{val:1745215714522539000, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, last_request_ts:1745215714522539, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745214049139168 max_table_version=1745214049139168 trans_version={val:1745215714522539000, v:0} commit_version={val:1745215714522539000, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001677} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:0, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,0,2,0,0,0)|]}} -{busy_cbs_cnt:1, oldest_busy_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, final_log_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, -{info_log_submitted:1 state_log_submitting:1 state_log_submitted:1 }-, -{downstream_state:"INIT", upstream:{id:-1}, participants:[{id:1}], redo_log_no:0, scheduler:"11.29.122.182:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:18446744073709551615, v:3}, max_appling_log_ts:{val:18446744073709551615, v:3}, max_applying_part_log_no:9223372036854775807, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], need_checksum:true, data_complete:false, is_dup_tx:false, exec_epoch:0, commit_parts:[{ls_id:{id:1}, exec_epoch:915283846840378, transfer_epoch:-1}], }- }-}, tx_expired=false, commit_expired=false, delay=200000) [2025-04-21 14:08:35.147779] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:721) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=220] trx is waiting log_cb(busy_cbs_.get_size()=1, busy_cbs_.get_first()={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, busy_cbs_.get_last()={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}) [2025-04-21 14:08:35.147830] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:718) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=41] handle timeout(ret=0, *this={this:0x7f3c4dd9d110, ref:4, trans_id:{txid:2001675}, tenant_id:1001, is_exiting:false, trans_expired_time:1745215744417911, cluster_version:17180066817, trans_need_wait_wrap:{receive_gts_ts_:[mts=0], need_wait_interval_us:0}, stc:[mts=1745215714418901], ctx_create_time:1745215714417930}{self_ls_id:{id:1}, session_id:1, associated_session_id:1, part_trans_action:3, pending_write:0, 2pc_role:"UNKNOWN", ctx_tx_data_:{ctx_mgr_:0x7f3c3e604030, tx_data_guard_:{tx_data:{tx_id:{txid:2001675}, ref_cnt:1, state:"ELR_COMMIT", commit_version:{val:1745215714417930000, v:0}, start_scn:{val:1745215714417930000, v:0}, end_scn:{val:18446744073709551615, v:3}, op_guard:{tx_data_op_:null}}}, read_only_:false}, role_state_:0, create_ctx_scn_:{val:18446744073709551615, v:3}, ctx_source:1, epoch_:915283742815797, replay_completeness_:1, upstream_state:"INIT", collected:[], rec_log_ts:{val:1745215714417930000, v:0}, prev_rec_log_ts:{val:18446744073709551615, v:3}, lastest_snapshot:{val:18446744073709551615, v:3}, last_request_ts:1745215714417930, block_frozen_memtable:null, max_2pc_commit_scn:{val:18446744073709551615, v:3}, mt_ctx_:{ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745214049139168 max_table_version=1745214049139168 trans_version={val:1745215714417930000, v:0} commit_version={val:1745215714417930000, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001675} ls_id=1 row_callback[alloc:1, free:0, unsubmit:0] redo[fill:2,sync_succ:0, sync_fail:0] main_list_len=2 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,2,2,0,2,0,0,0)|]}} -{busy_cbs_cnt:1, oldest_busy_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, final_log_cb:{ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, -{info_log_submitted:1 state_log_submitting:1 state_log_submitted:1 }-, -{downstream_state:"INIT", upstream:{id:-1}, participants:[{id:1}], redo_log_no:0, scheduler:"11.29.122.182:2882", prepare_version:{val:18446744073709551615, v:3}, trans_type:0, next_log_entry_no:1, max_applied_log_ts:{val:18446744073709551615, v:3}, max_appling_log_ts:{val:18446744073709551615, v:3}, max_applying_part_log_no:9223372036854775807, max_submitted_seq_no:{branch:0, seq:3}, checksum:[0], checksum_scn:[{val:0, v:0}], need_checksum:true, data_complete:false, is_dup_tx:false, exec_epoch:0, commit_parts:[{ls_id:{id:1}, exec_epoch:915283742815797, transfer_epoch:-1}], }- }-}, tx_expired=false, commit_expired=false, delay=200000) [2025-04-21 14:08:35.147953] INFO [STORAGE.TRANS] handle_timeout (ob_trans_part_ctx.cpp:721) [620129][T1001_TransTime][T1001][Y0-0000000000000000-0-0] [lt=121] trx is waiting log_cb(busy_cbs_.get_size()=1, busy_cbs_.get_first()={ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, busy_cbs_.get_last()={ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}) [2025-04-21 14:08:35.154905] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:35.178394] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=35] ts response task statistics(alloc_count=2310, free_count=1154) [2025-04-21 14:08:35.198208] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=95] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:35.212511] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE4-0-0] [lt=29] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:35.212569] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE4-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:35.217228] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65697576}], scn_array=[cnt:1, {val:1745215714322263001, v:0}], curr_size=122, accum_size=3534, time_cost=720814) [2025-04-21 14:08:35.217302] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:08:35.217342] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=63209, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:35.217352] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=212021, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:35.217360] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=5, stat_interval=1000000, avg (count/cost)=170013, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:35.217380] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=37][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:25957390}], scn_array=[cnt:1, {val:1745215714417930000, v:0}], curr_size=589, accum_size=8319, time_cost=798318) [2025-04-21 14:08:35.217398] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8734095}], scn_array=[cnt:1, {val:1745215714176938001, v:0}], curr_size=122, accum_size=1211, time_cost=843850) [2025-04-21 14:08:35.217415] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8319) [2025-04-21 14:08:35.217398] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17322454}], scn_array=[cnt:1, {val:1745215714176938002, v:0}], curr_size=122, accum_size=973, time_cost=844007) [2025-04-21 14:08:35.217434] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:35.217447] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:35.217442] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=973) [2025-04-21 14:08:35.217463] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:35.217439] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=7, avg_log_batch_cnt=1, total_group_log_size=3194, avg_group_log_size=456) [2025-04-21 14:08:35.217477] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=23, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:35.217520] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8319) [2025-04-21 14:08:35.217581] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:35.217598] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=63345, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:35.217611] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=63299, avg_log_submit_to_slide_time=63320) [2025-04-21 14:08:35.217628] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=15721, log_task={header:{begin_lsn:{lsn:25957390}, end_lsn:{lsn:25957979}, log_id:15721, min_scn:{val:1745215714417930000, v:0}, max_scn:{val:1745215714417930000, v:0}, data_len:533, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:25957390}, data_checksum:193218202, accum_checksum:3572513777, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714418958, freeze_ts:1745215714418966, submit_ts:1745215714418981, flushed_ts:1745215715217510, gen_to_freeze cost time:8, gen_to_submit cost time:23, submit_to_flush cost time:798529}, fs_cb_begin_ts=1745215715217572, log_life_time=798614) [2025-04-21 14:08:35.217609] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215714417930000, v:0}, log_ts:{val:1745215714417930000, v:0}, lsn:{lsn:25957446}, submit_ts:1745215714418950}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2001675}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=798650, ctx_lock_wait_time=4) [2025-04-21 14:08:35.217513] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=45][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=14351, log_task={header:{begin_lsn:{lsn:65697576}, end_lsn:{lsn:65697698}, log_id:14351, min_scn:{val:1745215714322263001, v:0}, max_scn:{val:1745215714322263001, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:65697576}, data_checksum:667309872, accum_checksum:2693315493, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714496339, freeze_ts:1745215714496347, submit_ts:1745215714496364, flushed_ts:1745215715217378, gen_to_freeze cost time:8, gen_to_submit cost time:25, submit_to_flush cost time:721014}, fs_cb_begin_ts=1745215715217494, log_life_time=721155) [2025-04-21 14:08:35.217715] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=366) [2025-04-21 14:08:35.217722] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8319, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:35.217757] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:35.217775] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=212361, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:35.217788] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=3, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=282572, avg_log_submit_to_slide_time=282596) [2025-04-21 14:08:35.217803] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4389] log_task life cost too much time(palf_id=1001, self="11.29.122.182:2882", log_id=13959, log_task={header:{begin_lsn:{lsn:8734095}, end_lsn:{lsn:8734217}, log_id:13959, min_scn:{val:1745215714176938001, v:0}, max_scn:{val:1745215714176938001, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:8734095}, data_checksum:2222604892, accum_checksum:1263571465, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714373462, freeze_ts:1745215714373465, submit_ts:1745215714373472, flushed_ts:1745215715217707, gen_to_freeze cost time:3, gen_to_submit cost time:10, submit_to_flush cost time:844235}, fs_cb_begin_ts=1745215715217744, log_life_time=844282) [2025-04-21 14:08:35.217836] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=5, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:35.217823] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215714218837000, v:0}, new_max_version={val:1745215714218837000, v:0}, last_min_version={val:1745215714018093000, v:0}, last_max_version={val:1745215714018093000, v:0}, total_time_us=800405, delta_us=998982) [2025-04-21 14:08:35.217852] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215714218837000, v:0}, min_version={val:1745215714218837000, v:0}, max_version={val:1745215714218837000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:35.217859] WDIAG [PALF] try_update_match_lsn_map_ (log_sliding_window.cpp:4122) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=0] [MATCH LSN ADVANCE DELAY]match_lsn advance delay too much time(ret=0, palf_id=1, self="11.29.122.182:2882", server="11.29.122.182:2882", update_func={old_end_lsn:{lsn:17322454}, new_end_lsn:{lsn:17322576}, old_advance_time_us:1745215714178785, new_ack_time_us:1745215715217857, advance delay(us):1039072}) [2025-04-21 14:08:35.217879] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=372) [2025-04-21 14:08:35.217883] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:35.217897] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:35.217912] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=212275, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:35.217923] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=3, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=282462, avg_log_submit_to_slide_time=282485) [2025-04-21 14:08:35.217937] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=10022, log_task={header:{begin_lsn:{lsn:17322454}, end_lsn:{lsn:17322576}, log_id:10022, min_scn:{val:1745215714176938002, v:0}, max_scn:{val:1745215714176938002, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:17322454}, data_checksum:667309872, accum_checksum:2052859064, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714373292, freeze_ts:1745215714373301, submit_ts:1745215714373318, flushed_ts:1745215715217855, gen_to_freeze cost time:9, gen_to_submit cost time:26, submit_to_flush cost time:844537}, fs_cb_begin_ts=1745215715217893, log_life_time=844601) [2025-04-21 14:08:35.217963] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=83, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:35.218000] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=244, hit_cnt=2, read_cnt=2, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:35.218030] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=372, hit_cnt=3, read_cnt=3, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:35.218062] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:35.218792] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215714417930000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=800856, in_cluster_service=true, cluster_version={val:1745215714218837000, v:0}, min_cluster_version={val:1745215714218837000, v:0}, max_cluster_version={val:1745215714218837000, v:0}, get_cluster_version_err=0, cluster_version_delta=999949, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=925, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=50039379, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:35.237960] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.241137] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB8-0-0] [lt=57] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:35.241211] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB8-0-0] [lt=62] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=78) [2025-04-21 14:08:35.255249] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDBF-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.257995] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=36] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:35.258115] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=118] check all tenants(ret=0) [2025-04-21 14:08:35.259403] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC2-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.260731] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC3-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.262039] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC4-0-0] [lt=33] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.263368] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC5-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.264660] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC6-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.265972] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC7-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.266783] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE25-0-0] [lt=28] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:35.266839] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE25-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.267258] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC8-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.268730] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:35.268783] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:35.268968] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:35.269162] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:35.269339] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:35.269418] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:753, total:773) [2025-04-21 14:08:35.269500] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:35.269561] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:753, total:773) [2025-04-21 14:08:35.269621] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:35.269646] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=1, async_total=0, sync_cnt= 0 0 0 0 0 1 0 0, async_cnt= 0 [2025-04-21 14:08:35.274025] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=5, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:35.274098] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=5, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:35.274138] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=5, avg_log_batch_cnt=1, total_group_log_size=610, avg_group_log_size=122) [2025-04-21 14:08:35.274166] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=610) [2025-04-21 14:08:35.274190] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=5, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:35.280292] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:35.292519] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=62] success to update min reserved snapshot(reserved_snapshot=1745213905554947000, duration=1800, snapshot_gc_ts=1745215705554947000) [2025-04-21 14:08:35.297025] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=6, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:35.320004] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF63-0-0] [lt=48] need check schema(new_schema_version=1745215649759944, cached_tenant_schema_version=1745215649759944, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=update __all_weak_read_service set min_version=?, max_version=? where tenant_id = ? and level_id = ? and level_value = ? and min_version = ? and max_version = ?) [2025-04-21 14:08:35.320465] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3065) [2025-04-21 14:08:35.338026] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.344500] INFO [STORAGE.REDO] write_logs (ob_storage_log_writer.cpp:512) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Slow write(duration=510030, write_len=4096) [2025-04-21 14:08:35.344563] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=62] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=3999, offset=56079}, end_cursor:ObLogCursor{file_id=3, log_id=4000, offset=56385}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77448050, len:1265, log_data_len:306, seq:3999, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:35.344954] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE48-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:35.345048] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE48-0-0] [lt=61] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215714176938002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215714176938002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:35.347704] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8734217}], scn_array=[cnt:1, {val:1745215715178105000, v:0}], curr_size=122, accum_size=122, time_cost=73540) [2025-04-21 14:08:35.347753] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65701794, this={dio_aligned_buf:{buf_write_offset:3028, buf_padding_size:1068, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3061, truncate_used_ts:1217}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65699840, buf_len=1074, total_write_size=36804, total_write_size_after_dio=446464, ob_pwrite_used_ts=1024715, count=100, each_pwrite_cost=10247) [2025-04-21 14:08:35.347792] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:25957979}], scn_array=[cnt:1, {val:1745215714417930001, v:0}], curr_size=710, accum_size=710, time_cost=130195) [2025-04-21 14:08:35.347795] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17322576}], scn_array=[cnt:1, {val:1745215715178105000, v:0}], curr_size=122, accum_size=122, time_cost=73699) [2025-04-21 14:08:35.347828] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=284120, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:35.347880] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65697698}], scn_array=[cnt:1, {val:1745215714522539000, v:0}], curr_size=1074, accum_size=1074, time_cost=130366) [2025-04-21 14:08:35.347911] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:35.347935] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:35.347955] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=4, avg_log_batch_cnt=1, total_group_log_size=2477, avg_group_log_size=619) [2025-04-21 14:08:35.347959] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=162] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1780) [2025-04-21 14:08:35.348014] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=4, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:35.347993] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=15722, log_task={header:{begin_lsn:{lsn:25957979}, end_lsn:{lsn:25958689}, log_id:15722, min_scn:{val:1745215714417930001, v:0}, max_scn:{val:1745215714522539001, v:0}, data_len:654, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:25957979}, data_checksum:3516658541, accum_checksum:364618245, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714449161, freeze_ts:1745215715217547, submit_ts:1745215715217558, flushed_ts:1745215715347883, gen_to_freeze cost time:768386, gen_to_submit cost time:768397, submit_to_flush cost time:130325}, fs_cb_begin_ts=1745215715347982, log_life_time=898821) [2025-04-21 14:08:35.348061] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT FLUSH CB COST TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=132, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:35.348062] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:35.348083] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=515791, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:35.348041] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=54][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:25958091}, submit_ts:1745215714523029}, this:0x7f3c4dd7adc0, is_inited_:true, trans_id:{txid:2001677}, ls_id:{id:1}, ctx:0x7f3c4dd773d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=824998, ctx_lock_wait_time=3) [2025-04-21 14:08:35.348104] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=3, avg_log_gen_to_freeze_time=231435, avg_log_gen_to_submit_time=231452, avg_log_submit_to_flush_time=284262, avg_log_submit_to_slide_time=284338) [2025-04-21 14:08:35.348102] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=12][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215714944226000, v:0}, log_ts:{val:1745215714944226000, v:0}, lsn:{lsn:65698283}, submit_ts:1745215714945177}, this:0x7f3c6b82f080, is_inited_:true, trans_id:{txid:2000948}, ls_id:{id:1}, ctx:0x7f3c6b82b690, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=402918, ctx_lock_wait_time=3) [2025-04-21 14:08:35.348134] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=14352, log_task={header:{begin_lsn:{lsn:65697698}, end_lsn:{lsn:65698772}, log_id:14352, min_scn:{val:1745215714522539000, v:0}, max_scn:{val:1745215714944226000, v:0}, data_len:1018, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:65697698}, data_checksum:1137809280, accum_checksum:4175528814, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215714523103, freeze_ts:1745215715217398, submit_ts:1745215715217423, flushed_ts:1745215715347948, gen_to_freeze cost time:694295, gen_to_submit cost time:694320, submit_to_flush cost time:130525}, fs_cb_begin_ts=1745215715348049, log_life_time=824946) [2025-04-21 14:08:35.348193] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FLUSH CB COST TIME](cur_stat_count=3, stat_interval=1000000, avg (count/cost)=197, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:35.348192] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=47] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213908742072000) [2025-04-21 14:08:35.348231] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] update reserved snapshot finished(cost_ts=899175, reserved_snapshot=1745213908742072000) [2025-04-21 14:08:35.348229] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=71][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215714522539000, v:0}, log_ts:{val:1745215714522539000, v:0}, lsn:{lsn:65697754}, submit_ts:1745215714523096}, this:0x7f3c6b50c3c0, is_inited_:true, trans_id:{txid:2000947}, ls_id:{id:1}, ctx:0x7f3c6b5089d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=825130, ctx_lock_wait_time=1) [2025-04-21 14:08:35.348808] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE48-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1745215715347789000, start_id=1745215715347789000, end_id=1745215715347789001) [2025-04-21 14:08:35.349138] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] update reserved snapshot finished(cost_ts=56621, reserved_snapshot=1745213905554947000) [2025-04-21 14:08:35.351404] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=30] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4000, offset=56385}, end_cursor:ObLogCursor{file_id=3, log_id=4001, offset=56682}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7744c050, len:959, log_data_len:297, seq:4000, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:35.351703] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE48-0-0] [lt=46] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:35.351755] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE48-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215715178105000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215715178105000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:35.355444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:35.364947] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=11400000, clean_num=200000) [2025-04-21 14:08:35.366763] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:35.366807] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=36] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.374099] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=2, avg_log_batch_cnt=1, total_group_log_size=244, avg_group_log_size=122) [2025-04-21 14:08:35.374143] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=244) [2025-04-21 14:08:35.374171] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=2, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:35.419138] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:35.426806] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=51] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:35.426858] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:35.426889] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:35.426926] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=34] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:35.426958] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=30] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254919977043, flush_io_finished_ret_:0, flush_io_finished_round_:107, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:35.428703] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:35.438102] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.445935] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:35.445990] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.448626] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=101] no need to update min/max version(new_version={val:1745215714322263000, v:0}, min_version={val:1745215714322263000, v:0}, max_version={val:1745215714322263000, v:0}) [2025-04-21 14:08:35.450459] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF6D-0-0] [lt=57] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:35.475384] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.475476] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.475519] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.475537] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.480432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:35.520800] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215715520544000, start_id=1745215715520544000, end_id=1745215715520544001) [2025-04-21 14:08:35.522444] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] get wrs ts(ls_id={id:1}, delta=168484, log_service_ts=1745215715353133, min_tx_service_ts=4611686018427387, timestamp={val:1745215715353133000, v:0}) [2025-04-21 14:08:35.522490] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=74, Other_Error_Cnt=0, Submit_Succ_Cnt=19, last_scn="{val:1745215714522539001, v:0}", last_lsn={lsn:25958624}, last_gts={val:1745215715450030000, v:0}, min_start_scn="{val:1745215714322263000, v:0}", min_start_status=2, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:08:35.537923] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215715537919, bytes: 4428144, bw: 0.013461 MB/s, add_ts: 1007625, add_bytes: 14223 [2025-04-21 14:08:35.538200] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.540827] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBB-0-0] [lt=51] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:35.563089] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=59][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:35.565419] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:35.566794] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:35.566846] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.570480] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:35.578129] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=56] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:35.578195] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=56] temporary file module use no blocks [2025-04-21 14:08:35.578214] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:35.578255] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:35.578277] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254920128353, flush_io_finished_ret_:0, flush_io_finished_round_:107, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:35.590550] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:35.596068] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=59] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:35.597191] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215715597186, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2025-04-21 14:08:35.602101] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:35.602143] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:35.603791] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:35.603827] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:35.638272] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.650614] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT APPEND COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:35.663610] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:35.664817] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:35.664917] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215708742072000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:35.678903] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1745215715677973000, start_id=1745215715677973000, end_id=1745215715677973001) [2025-04-21 14:08:35.678961] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=53] handle gts request statistics(total_rt=449, total_cnt=60, avg_rt=7.360655737704917989e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:08:35.679008] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:35.679058] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215715679038], gts:1745215715679037000, latest_srr:[mts=1745215715679038]}) [2025-04-21 14:08:35.680566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:35.694985] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695177] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695519] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695595] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695801] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695846] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695888] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.695967] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.696044] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.696059] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.696353] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:35.707592] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17323186}, readable_log_tail:{lsn:17323186}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49781582, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:35.707724] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=130] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:08:35.707756] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=27] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8734827}, readable_log_tail:{lsn:8734827}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58369941, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:35.707821] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=63] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:08:35.707856] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=13] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:35.735601] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=75] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:35.738350] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.740817] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=21] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:08:35.740865] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=43] finish to resize log external storage handler(current_ts=1745215715740861, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:35.743783] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] Garbage Collector is running(seq_=11, gc_interval=10000000) [2025-04-21 14:08:35.743856] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:35.743887] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=27] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:35.743913] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_check_member_list_ cost time(ret=0, time_us=89) [2025-04-21 14:08:35.743938] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:35.745333] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:35.746594] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=35] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:35.746635] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=36] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:35.746661] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:35.746681] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=48) [2025-04-21 14:08:35.746715] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=29] ObSafeDestroyHandler start process [2025-04-21 14:08:35.760264] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9B-0-0] [lt=18] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:08:35.760316] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9B-0-0] [lt=44] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:08:35.765879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:35.786996] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=65] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:35.811514] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=36] ====== check clog disk timer task ====== [2025-04-21 14:08:35.811575] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=54] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:35.819206] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:08:35.827450] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10028, max_lsn:17323308, max_scn:{val:1745215715679037000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17323308}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17323186}, last_submit_end_lsn:{lsn:17323308}, last_submit_log_id:10028, last_submit_log_pid:3, max_flushed_lsn:{lsn:17323186}, max_flushed_end_lsn:{lsn:17323308}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17323308}, last_slide_log_id:10028, last_slide_scn:{val:1745215715679037000, v:0}, last_slide_lsn:{lsn:17323186}, last_slide_end_lsn:{lsn:17323308}, last_slide_log_pid:3, last_slide_log_accum_checksum:1840901688, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10029, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17323308}, readable_log_tail:{lsn:17323308}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49781460, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:08:35.827710] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=253] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215715776028, last_flushed_end_lsn:{lsn:17323308}}]) [2025-04-21 14:08:35.827735] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10029, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215715776028, last_flushed_end_lsn:{lsn:17323308}}]) [2025-04-21 14:08:35.827785] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:13965, max_lsn:8734949, max_scn:{val:1745215715679037000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8734949}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8734827}, last_submit_end_lsn:{lsn:8734949}, last_submit_log_id:13965, last_submit_log_pid:3, max_flushed_lsn:{lsn:8734827}, max_flushed_end_lsn:{lsn:8734949}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8734949}, last_slide_log_id:13965, last_slide_scn:{val:1745215715679037000, v:0}, last_slide_lsn:{lsn:8734827}, last_slide_end_lsn:{lsn:8734949}, last_slide_log_pid:3, last_slide_log_accum_checksum:1922316036, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:13966, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8734949}, readable_log_tail:{lsn:8734949}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58369819, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:08:35.827950] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=161] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215715776113, last_flushed_end_lsn:{lsn:8734949}}]) [2025-04-21 14:08:35.827968] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=17] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=13966, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215715776113, last_flushed_end_lsn:{lsn:8734949}}]) [2025-04-21 14:08:35.828723] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:35.830118] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:08:35.838418] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.848480] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE23-0-0] [lt=31] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:35.848546] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE23-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:35.866923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:35.866984] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.868976] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:35.885628] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5300000, replace_num=100000) [2025-04-21 14:08:35.885678] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:35.915291] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=66] BlockGCTimerTask success(ret=0, cost_time_us=10, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:35.923455] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=71] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:35.927524] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=26] LogLoopThread round_cost_time(us)(round_cost_time=568) [2025-04-21 14:08:35.938489] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:35.946131] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:35.946198] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:35.966359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:35.997578] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3586) [2025-04-21 14:08:35.998972] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=36] [APPLY STAT CB APPEND COST TIME](cur_stat_count=32, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:35.999022] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=49] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=32, stat_interval=5000000, avg (count/cost)=1565, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:35.999038] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=32, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:35.999062] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=23] [APPLY STAT CB EXECUTE TIME](cur_stat_count=32, stat_interval=5000000, avg (count/cost)=-585, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:35.999077] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0050-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=32, stat_interval=5000000, avg (count/cost)=1042, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:36.033129] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=59] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:36.036557] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0058-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:36.038558] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.039039] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0058-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254921589346, cache_obj->added_lc()=false, cache_obj->get_object_id()=654, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:36.067002] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:36.067081] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.085790] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:36.101193] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:36.101242] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:36.101268] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:36.101291] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=20] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:36.104453] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:36.104734] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=278] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:36.110180] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:36.111811] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9B-0-0] [lt=41] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=81) [2025-04-21 14:08:36.112055] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215716111429000, start_id=1745215716111429000, end_id=1745215716111429001) [2025-04-21 14:08:36.138626] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.166887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:36.179549] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215716179515], gts:1745215716178590000, latest_srr:[mts=1745215716179515]}) [2025-04-21 14:08:36.214170] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE5-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:36.214217] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE5-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:36.234908] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDC9-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:36.238706] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.250737] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4455, avg_group_log_size=371) [2025-04-21 14:08:36.252126] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=5529) [2025-04-21 14:08:36.252194] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=11249, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:36.252238] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8483) [2025-04-21 14:08:36.252255] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=5529, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:36.252282] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:36.252332] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8483) [2025-04-21 14:08:36.252345] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215716050503000, v:0}, new_max_version={val:1745215716050503000, v:0}, last_min_version={val:1745215715849724000, v:0}, last_max_version={val:1745215715849724000, v:0}, total_time_us=3149, delta_us=201839) [2025-04-21 14:08:36.252378] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215716050503000, v:0}, min_version={val:1745215716050503000, v:0}, max_version={val:1745215716050503000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:36.252396] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:36.252419] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=72612, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:36.252434] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=61228, avg_log_gen_to_submit_time=61244, avg_log_submit_to_flush_time=11341, avg_log_submit_to_slide_time=11367) [2025-04-21 14:08:36.252485] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8483, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:36.268292] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE26-0-0] [lt=15] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:36.268354] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE26-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:36.270614] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:36.270681] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:36.270882] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:36.271075] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:36.271159] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:17, schedule:35, submit:10, rt:255473, total:255535) [2025-04-21 14:08:36.271236] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:36.271295] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:17, schedule:35, submit:10, device:255473, total:255535) [2025-04-21 14:08:36.271360] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:36.271436] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:74712, total:74728) [2025-04-21 14:08:36.271526] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:36.271566] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:74712, total:74728) [2025-04-21 14:08:36.271633] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:36.271660] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:36.285936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:36.321127] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:08:36.322799] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:36.338777] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.357275] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4001, offset=56682}, end_cursor:ObLogCursor{file_id=3, log_id=4002, offset=56988}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77450050, len:662, log_data_len:306, seq:4001, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:36.357571] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:36.357643] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215716111429000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215716111429000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:36.360755] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:36.360806] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8908, avg_group_log_size=685) [2025-04-21 14:08:36.362009] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:36.363549] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4002, offset=56988}, end_cursor:ObLogCursor{file_id=3, log_id=4003, offset=57285}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77454050, len:4452, log_data_len:297, seq:4002, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:36.363793] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:36.363846] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE49-0-0] [lt=33] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215716111429000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215716111429000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:36.367055] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:36.367105] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.367473] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:36.374865] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:36.374920] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2025-04-21 14:08:36.374952] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1522) [2025-04-21 14:08:36.374980] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:36.375019] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:36.375050] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:36.375074] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:36.375095] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:36.376346] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7931, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:36.376395] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1766) [2025-04-21 14:08:36.376407] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7901, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:36.376429] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:36.376446] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:08:36.376458] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1766) [2025-04-21 14:08:36.376475] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:36.376522] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:36.376547] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8058, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:36.376571] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=8011, avg_log_submit_to_slide_time=8029) [2025-04-21 14:08:36.376607] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:36.376637] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:08:36.376664] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:36.376683] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8019, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:36.376700] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=7995, avg_log_submit_to_slide_time=8006) [2025-04-21 14:08:36.376720] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:36.376751] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1766, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:36.376784] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:36.397836] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:36.397894] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:36.399532] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1288, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:36.399586] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:36.399645] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4577) [2025-04-21 14:08:36.399703] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:36.399726] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=5680, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:36.399746] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4268, avg_log_gen_to_submit_time=4287, avg_log_submit_to_flush_time=1376, avg_log_submit_to_slide_time=1393) [2025-04-21 14:08:36.399778] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:36.401714] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:08:36.401759] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:36.419201] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:36.427102] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=50] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:36.427154] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:36.427171] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:36.427191] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:36.427216] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254920977327, flush_io_finished_ret_:0, flush_io_finished_round_:108, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:36.428892] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=47] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:36.438853] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.446330] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:36.446392] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.449352] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215716249919000, v:0}, base_version={val:1745215716050503000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215716249919000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215716449317, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:36.457146] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=87] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:08:36.475145] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.475219] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.475232] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.475472] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.483619] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:08:36.486070] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:36.506944] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=38][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:36.521392] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF69-0-0] [lt=42] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:36.533064] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=101] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:36.538925] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.545531] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215716545527, bytes: 4440916, bw: 0.012088 MB/s, add_ts: 1007608, add_bytes: 12772 [2025-04-21 14:08:36.566029] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=30] ====== check clog disk timer task ====== [2025-04-21 14:08:36.566084] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:36.567197] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:36.567236] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.567936] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:36.570549] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:36.578416] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=52] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:36.578472] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:36.578490] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:36.578521] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:36.578558] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254921128647, flush_io_finished_ret_:0, flush_io_finished_round_:108, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:36.579652] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF005A-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:36.582004] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF005A-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254922132311, cache_obj->added_lc()=false, cache_obj->get_object_id()=655, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:36.583124] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF005E-0-0] [lt=41][errcode=-4201] hashtable not init [2025-04-21 14:08:36.583159] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF005E-0-0] [lt=33] get cursor info failed(cursor_id=35, get_sessid()=3221487630) [2025-04-21 14:08:36.583285] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1745215716582454000, start_id=1745215716582454000, end_id=1745215716582454001) [2025-04-21 14:08:36.590707] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:36.602047] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:36.602088] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:36.603820] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:36.603858] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:36.604813] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215716604808, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2025-04-21 14:08:36.639014] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.650929] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1745215716650603000, start_id=1745215716650603000, end_id=1745215716650603001) [2025-04-21 14:08:36.651552] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:36.653052] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF85-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:36.656157] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215716655962000, start_id=1745215716655962000, end_id=1745215716655962001) [2025-04-21 14:08:36.657905] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF89-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:36.672475] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] [COMPACTION DAG STATUS] (start_time=1745215706669570, end_time=1745215716672472, dag_status={}) [2025-04-21 14:08:36.672522] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=42] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672542] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672581] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672635] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:36.672687] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672710] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672749] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672806] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672859] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672878] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672896] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672968] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.672986] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673042] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673061] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673079] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673098] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673116] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673135] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673171] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673244] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673281] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673298] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673315] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673333] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673367] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673384] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673402] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673419] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673455] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673508] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673525] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673579] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673614] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673632] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673650] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673668] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673686] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673703] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673721] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673773] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673791] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673826] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673844] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673862] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673881] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673916] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673934] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673952] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:36.673971] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:36.673989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:36.674007] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:36.674022] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:36.674038] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:36.674053] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:36.674067] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:36.674082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:36.674178] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=95] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:36.674195] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:36.674215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(dag_cnt=0, total_worker_cnt_=1, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:36.680075] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:36.684721] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:08:36.684767] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:36.684808] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:36.686210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:36.694923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.695093] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=61] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.695454] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.695525] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.695699] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.695958] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.696017] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.696051] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.696077] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=52] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.696277] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.696464] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:36.726790] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDDD-0-0] [lt=35] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:36.739165] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=79] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:36.739199] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:36.739218] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.768409] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:36.787107] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:36.790590] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDDF-0-0] [lt=40] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:36.808328] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=31] ====== traversal_flush timer task ====== [2025-04-21 14:08:36.808434] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9C-0-0] [lt=42] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:36.808576] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9C-0-0] [lt=134] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:36.819281] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:36.823177] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=57] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:36.823227] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:08:36.823251] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:36.823277] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:36.823301] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254921373415, flush_io_finished_ret_:0, flush_io_finished_round_:108, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:36.828861] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=25] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:36.836702] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:36.837649] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:36.837706] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=55] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:36.837772] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:36.837856] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=79] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:36.837901] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:36.837926] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215708564600001, v:0}) [2025-04-21 14:08:36.837944] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:36.837962] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:36.837985] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:36.838017] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:36.838041] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:36.838086] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:36.838122] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:36.838142] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:36.839156] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.850406] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE24-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:36.850473] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE24-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:36.867209] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:36.867259] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.886392] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:36.905911] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDCA-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215716905888}) [2025-04-21 14:08:36.905995] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDCA-0-0] [lt=57] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215716905989}) [2025-04-21 14:08:36.905973] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE3-0-0] [lt=27] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215716905946, sql_renew_time:1745215716905946, is_mark_fail:false}]) [2025-04-21 14:08:36.906022] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE3-0-0] [lt=48] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215716905888}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215716905946, sql_renew_time:1745215716905946, is_mark_fail:false}]) [2025-04-21 14:08:36.906062] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE4-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:36.906511] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE4-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215716906499, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:36.906544] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE4-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215716905989}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215716906499, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:36.907660] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDCA-0-0] [lt=25] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:36.913686] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=42] start to print blacklist info [2025-04-21 14:08:36.913846] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] ls blacklist refresh finish(cost_time=9319) [2025-04-21 14:08:36.917532] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDE1-0-0] [lt=42] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:36.921640] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=60] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:36.929509] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=38] runTimer to refresh locality_info(ret=0) [2025-04-21 14:08:36.931361] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=30] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:08:36.931422] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=52] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:08:36.931450] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=26] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:08:36.931479] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=22] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:08:36.931498] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=18] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:08:36.931522] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:08:36.931540] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:08:36.931559] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:08:36.939226] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:36.943040] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8F-0-0] [lt=22] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215711999493, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:36.943095] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8F-0-0] [lt=52] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215712001564, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:36.943122] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD8F-0-0] [lt=26] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215712003005, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215712003000, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:36.946496] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:36.946544] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:36.955529] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=45] current monitor number(seq_=-1) [2025-04-21 14:08:36.968878] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:36.998312] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3971) [2025-04-21 14:08:37.008136] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:37.008175] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=36] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:37.008171] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB4-0-0] [lt=20] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:37.008209] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB4-0-0] [lt=36] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:37.033249] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:37.039310] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.042649] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0060-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:37.044909] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0060-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254922595217, cache_obj->added_lc()=false, cache_obj->get_object_id()=656, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.050227] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=16] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=543141888, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=530599936, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:37.050324] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=57] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:37.050358] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=168, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:37.050429] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:37.050498] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:37.050520] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=10, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:37.067332] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:37.067381] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.086517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:37.098319] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=62] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:37.098387] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=65] try gc retain ctx [2025-04-21 14:08:37.098411] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] try to retry start_working [2025-04-21 14:08:37.098500] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=36] finish update min start scn(max_decided_scn={val:1745215717050405000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215706916796001, v:0}, keep_alive_scn_:{val:1745215711920278001, v:0}, update_ts_:1745215717098400}) [2025-04-21 14:08:37.100027] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215725197259000, latest_log_ts:{val:1745215708564600001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:37.123422] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215716920791000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215717123379}, version_delta=202628) [2025-04-21 14:08:37.139379] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.149814] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215716850316000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=299489, in_cluster_service=true, cluster_version={val:1745215716850316000, v:0}, min_cluster_version={val:1745215716850316000, v:0}, max_cluster_version={val:1745215716850316000, v:0}, get_cluster_version_err=0, cluster_version_delta=299489, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=973, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=54679942, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:37.169326] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:37.180641] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=72] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=326, get_gts_with_stc_cnt=26, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=25, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:37.206281] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=85] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:37.215790] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE6-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:37.215837] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE6-0-0] [lt=44] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:37.239465] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.241778] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB9-0-0] [lt=54] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:37.241844] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDB9-0-0] [lt=57] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=69) [2025-04-21 14:08:37.251578] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4084, avg_group_log_size=371) [2025-04-21 14:08:37.251889] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1745215717250906000, start_id=1745215717250906000, end_id=1745215717250906001) [2025-04-21 14:08:37.253242] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1379, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:37.253291] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7774) [2025-04-21 14:08:37.253309] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4084) [2025-04-21 14:08:37.253341] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:37.253372] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:08:37.253438] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:37.253454] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4084, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:37.253465] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1510, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:37.253557] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215717050405000, v:0}, new_max_version={val:1745215717050405000, v:0}, last_min_version={val:1745215716850316000, v:0}, last_max_version={val:1745215716850316000, v:0}, total_time_us=3640, delta_us=203150) [2025-04-21 14:08:37.253576] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=109] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1467, avg_log_submit_to_slide_time=1489) [2025-04-21 14:08:37.253600] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215717050405000, v:0}, min_version={val:1745215717050405000, v:0}, max_version={val:1745215717050405000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:37.253635] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7774, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:37.269822] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE27-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:37.269884] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE27-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:37.272695] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=14kB/s, net_out=14kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:37.272761] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:37.272939] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:37.273172] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:37.273264] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:15, schedule:29, submit:7, rt:1252, total:1304) [2025-04-21 14:08:37.273346] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:37.273412] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:15, schedule:29, submit:7, device:1252, total:1304) [2025-04-21 14:08:37.273478] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:37.273561] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:616, total:632) [2025-04-21 14:08:37.273641] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:37.273679] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:616, total:632) [2025-04-21 14:08:37.273740] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:37.273768] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:37.286639] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:37.315928] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:37.317210] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=69] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:37.317311] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215711165280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:37.322699] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:08:37.339547] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=93][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.367396] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:37.367486] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=81] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.369820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:37.369868] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4003, offset=57285}, end_cursor:ObLogCursor{file_id=3, log_id=4004, offset=57591}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77458050, len:4155, log_data_len:306, seq:4003, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:37.370310] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:37.370387] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215717180584000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215717180584000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:37.375006] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:37.375315] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=286] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7774, avg_group_log_size=647) [2025-04-21 14:08:37.375612] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:37.375695] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:37.375737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:37.375770] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:37.375805] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:37.375835] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1720, avg_group_log_size=191) [2025-04-21 14:08:37.375858] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1720) [2025-04-21 14:08:37.375886] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:37.376984] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=69, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:37.377069] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1407, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:37.377100] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1720) [2025-04-21 14:08:37.377121] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1411, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:37.377134] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:37.377158] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:37.377187] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:37.377197] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1720) [2025-04-21 14:08:37.377278] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:37.377311] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1521, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:37.377334] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1494, avg_log_submit_to_slide_time=1511) [2025-04-21 14:08:37.377374] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:37.377420] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:08:37.377465] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:37.377491] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1549, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:37.377509] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1511, avg_log_submit_to_slide_time=1525) [2025-04-21 14:08:37.377616] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=98] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:37.377684] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1720, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:37.377735] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:37.378857] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=58] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4004, offset=57591}, end_cursor:ObLogCursor{file_id=3, log_id=4005, offset=57888}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7745c050, len:3849, log_data_len:297, seq:4004, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:37.379241] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:37.379320] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4A-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215717180584000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215717180584000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:37.380458] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=11600000, clean_num=200000) [2025-04-21 14:08:37.398645] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=150] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:37.398771] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=98] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:37.400389] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1455, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:37.400485] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=80] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:37.400541] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4084) [2025-04-21 14:08:37.400642] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:37.400681] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1601, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:37.400711] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1546, avg_log_submit_to_slide_time=1568) [2025-04-21 14:08:37.400768] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:37.419274] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:37.427354] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:37.427418] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:08:37.427437] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:37.427460] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=20] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:37.427485] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254921977576, flush_io_finished_ret_:0, flush_io_finished_round_:109, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:37.429070] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:37.439609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=101][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.446747] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:37.446849] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=90] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.474895] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.475221] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.475531] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.475800] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.486794] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:37.522224] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF6E-0-0] [lt=63] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:37.524934] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=93] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:37.539692] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.546014] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBC-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:37.547181] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=36] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:37.548367] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:37.548465] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215715562497000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:37.553150] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1745215717553145, bytes: 4455632, bw: 0.013928 MB/s, add_ts: 1007618, add_bytes: 14716 [2025-04-21 14:08:37.567476] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:37.567603] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=119] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.570623] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=31] gc stale ls task succ [2025-04-21 14:08:37.580043] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0062-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:37.580967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:37.582574] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0062-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254923132879, cache_obj->added_lc()=false, cache_obj->get_object_id()=657, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.590883] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:37.599540] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:37.599598] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=42] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=22) [2025-04-21 14:08:37.602403] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:37.602450] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:37.604170] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:37.604207] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:37.612412] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215717612408, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2025-04-21 14:08:37.632446] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=59] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:37.639762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=79][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.652230] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:37.677486] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=29, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:37.677559] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=72] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=10004, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:37.677575] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:37.677601] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=24] [APPLY STAT CB EXECUTE TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=-593, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:37.677621] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=14, stat_interval=5000000, avg (count/cost)=9440, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:37.681172] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:37.681486] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=65] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215717681469], gts:1745215717680867000, latest_srr:[mts=1745215717681469]}) [2025-04-21 14:08:37.686936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:37.688467] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=51] log compressor cycles once. (ret=0, cost_time=1086, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585092845568, fast_delete_log_mode=false) [2025-04-21 14:08:37.694772] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=55] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.694791] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.694830] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.695711] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.695938] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.695945] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.695986] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.696031] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.696090] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.696365] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.696552] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:37.739850] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.781511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:37.787269] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:37.795911] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:37.811699] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:08:37.811773] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=64] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:37.819356] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=57] gc stale ls task succ [2025-04-21 14:08:37.823448] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:37.823522] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=62] temporary file module use no blocks [2025-04-21 14:08:37.823562] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:37.823602] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=36] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:37.823639] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254922373661, flush_io_finished_ret_:0, flush_io_finished_round_:109, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:37.829060] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:37.831595] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:08:37.836505] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0064-0-0] [lt=44] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10006, add_timestamp:1745215717836475}) [2025-04-21 14:08:37.836587] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE5-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10006, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717836546, sql_renew_time:1745215717836546, is_mark_fail:false}]) [2025-04-21 14:08:37.836651] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE5-0-0] [lt=61] success to process renew task(task={tenant_id:1, table_id:10006, add_timestamp:1745215717836475}, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717836546, sql_renew_time:1745215717836546, is_mark_fail:false}]) [2025-04-21 14:08:37.836930] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0064-0-0] [lt=60][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=secure_file_priv) [2025-04-21 14:08:37.837215] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0064-0-0] [lt=42][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=external_user) [2025-04-21 14:08:37.838671] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0066-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1745215717838647}) [2025-04-21 14:08:37.838711] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE6-0-0] [lt=31] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.839246] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE6-0-0] [lt=36] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717839230, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.839289] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE6-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215717838647}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717839230, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.839922] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.852109] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE25-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:37.852182] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE25-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:37.853334] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0067-0-0] [lt=45] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215717853310}) [2025-04-21 14:08:37.853388] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE7-0-0] [lt=27] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.853428] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=65] new mysql sessid created(conn.sessid_=3221487774, support_ssl=false) [2025-04-21 14:08:37.853566] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40] sm conn init succ(conn.sessid_=3221487774, sess.client_addr_="127.0.0.1:32894") [2025-04-21 14:08:37.853604] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487774, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:190}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.853652] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=36] new mysql sessid created(conn.sessid_=3221487775, support_ssl=false) [2025-04-21 14:08:37.853696] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487775, sess.client_addr_="127.0.0.1:32904") [2025-04-21 14:08:37.853719] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487775, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.853708] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=56] new mysql sessid created(conn.sessid_=3221487776, support_ssl=false) [2025-04-21 14:08:37.853780] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=48] new mysql sessid created(conn.sessid_=3221487777, support_ssl=false) [2025-04-21 14:08:37.853795] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487776, sess.client_addr_="127.0.0.1:32914") [2025-04-21 14:08:37.853830] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221487777, sess.client_addr_="127.0.0.1:32910") [2025-04-21 14:08:37.853832] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487776, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:192}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.853853] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487777, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.853879] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34] new mysql sessid created(conn.sessid_=3221487778, support_ssl=false) [2025-04-21 14:08:37.853927] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] sm conn init succ(conn.sessid_=3221487778, sess.client_addr_="127.0.0.1:32924") [2025-04-21 14:08:37.853950] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487778, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.853989] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487779, support_ssl=false) [2025-04-21 14:08:37.854025] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=15] sm conn init succ(conn.sessid_=3221487779, sess.client_addr_="127.0.0.1:32956") [2025-04-21 14:08:37.854048] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c65b94030, session_id:3221487779, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854080] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487781, support_ssl=false) [2025-04-21 14:08:37.854077] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] new mysql sessid created(conn.sessid_=3221487780, support_ssl=false) [2025-04-21 14:08:37.854116] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=13] sm conn init succ(conn.sessid_=3221487781, sess.client_addr_="127.0.0.1:32964") [2025-04-21 14:08:37.854120] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487780, sess.client_addr_="127.0.0.1:32980") [2025-04-21 14:08:37.854140] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3c65b96030, session_id:3221487781, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854141] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3c65b94d70, session_id:3221487780, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854248] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=60] new mysql sessid created(conn.sessid_=3221487782, support_ssl=false) [2025-04-21 14:08:37.854303] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=30] sm conn init succ(conn.sessid_=3221487782, sess.client_addr_="127.0.0.1:32940") [2025-04-21 14:08:37.854331] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3c65b96d70, session_id:3221487782, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854370] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=43] new mysql sessid created(conn.sessid_=3221487783, support_ssl=false) [2025-04-21 14:08:37.854376] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487784, support_ssl=false) [2025-04-21 14:08:37.854429] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221487784, sess.client_addr_="127.0.0.1:32986") [2025-04-21 14:08:37.854433] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=30] sm conn init succ(conn.sessid_=3221487783, sess.client_addr_="127.0.0.1:33008") [2025-04-21 14:08:37.854450] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc8004030, session_id:3221487784, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854456] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c65b98030, session_id:3221487783, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854488] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487785, support_ssl=false) [2025-04-21 14:08:37.854527] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] sm conn init succ(conn.sessid_=3221487785, sess.client_addr_="127.0.0.1:33016") [2025-04-21 14:08:37.854549] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3bc8004d70, session_id:3221487785, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854558] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=35] new mysql sessid created(conn.sessid_=3221487786, support_ssl=false) [2025-04-21 14:08:37.854605] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487786, sess.client_addr_="127.0.0.1:33000") [2025-04-21 14:08:37.854615] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854659] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.854643] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] accept one succ(*s={this:0x7f3c65b98d70, session_id:3221487786, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.854680] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=20] mysql login queue(mysql_queue->queue_.size()=1) [2025-04-21 14:08:37.854740] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854779] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.854766] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=50] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854821] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=32] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.854872] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=27] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854860] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAB-0-0] [lt=34] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.854904] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.854949] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854979] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.854964] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA8-0-0] [lt=29] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.854965] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAC-0-0] [lt=32] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.854992] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.854974] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE7-0-0] [lt=36] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717854928, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.855021] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=22] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855018] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=25] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855032] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE7-0-0] [lt=56] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215717853310}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717854928, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.855047] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=24] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855053] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855076] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855100] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855106] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855131] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855132] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855163] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855166] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855184] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855188] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855221] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=20] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:37.855241] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:37.855752] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAB-0-0] [lt=40] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487783, proxy_sessid=0, client_sessid=3221487783, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.855877] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAC-0-0] [lt=49] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.856082] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA8-0-0] [lt=42] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487781, proxy_sessid=0, client_sessid=3221487781, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.856135] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAC-0-0] [lt=46] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487780, proxy_sessid=0, client_sessid=3221487780, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.856169] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0068-0-0] [lt=43] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215717856150}) [2025-04-21 14:08:37.856214] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0068-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215717856209}) [2025-04-21 14:08:37.856249] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA9-0-0] [lt=70] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.856213] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE8-0-0] [lt=35] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856196, sql_renew_time:1745215717856196, is_mark_fail:false}]) [2025-04-21 14:08:37.856272] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE8-0-0] [lt=57] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215717856150}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856196, sql_renew_time:1745215717856196, is_mark_fail:false}]) [2025-04-21 14:08:37.856298] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAD-0-0] [lt=56] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.856313] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE9-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856304, sql_renew_time:1745215717856304, is_mark_fail:false}]) [2025-04-21 14:08:37.856332] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDE9-0-0] [lt=18] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215717856209}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856304, sql_renew_time:1745215717856304, is_mark_fail:false}]) [2025-04-21 14:08:37.856599] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA1-0-0] [lt=35] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215717856576}) [2025-04-21 14:08:37.856624] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEA-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.856614] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB3-0-0] [lt=78][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215717856578}) [2025-04-21 14:08:37.856657] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB3-0-0] [lt=41][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215717856578}) [2025-04-21 14:08:37.856648] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAC-0-0] [lt=39] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487779, proxy_sessid=0, client_sessid=3221487779, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.856676] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB3-0-0] [lt=16][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702863198, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.856750] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAD-0-0] [lt=29] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.857121] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDA9-0-0] [lt=20] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487778, proxy_sessid=0, client_sessid=3221487778, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.857242] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAA-0-0] [lt=39] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.857358] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAD-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487777, proxy_sessid=0, client_sessid=3221487777, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.857388] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD94-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215717857379}) [2025-04-21 14:08:37.857506] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAE-0-0] [lt=50] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.857515] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAD-0-0] [lt=18] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487776, proxy_sessid=0, client_sessid=3221487776, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.857036] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEA-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856999, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.857624] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAE-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.857636] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEA-0-0] [lt=599] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215717856576}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856999, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.857696] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEB-0-0] [lt=43] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.857757] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD8C-0-0] [lt=19] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215717857741}) [2025-04-21 14:08:37.857828] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD95-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215717857823}) [2025-04-21 14:08:37.857880] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD95-0-0] [lt=40] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215717857878}) [2025-04-21 14:08:37.857903] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD95-0-0] [lt=15] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215717857902}) [2025-04-21 14:08:37.857923] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD95-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215717857921}) [2025-04-21 14:08:37.857951] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD95-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215717857950}) [2025-04-21 14:08:37.858082] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=14][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b94030, session_id:3221487779, trace_id:YB420B1D7AB6-00063343B6AEFD8F-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.858148] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=55] kill and revert session(conn.sessid_=3221487779, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.858137] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=39][errcode=0] server close connection(sessid=3221487779, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.858185] INFO [SERVER] process (obmp_quit.h:56) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=43] quit [2025-04-21 14:08:37.858207] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=20][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.858227] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=19][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.858244] WDIAG [SERVER] response (obmp_base.cpp:87) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=15][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.858261] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=15][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.858284] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858299] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD8F-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858311] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858371] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAE-0-0] [lt=20] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487784, proxy_sessid=0, client_sessid=3221487784, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.858386] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=12][errcode=0] server close connection(sessid=3221487777, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.858408] INFO [SERVER] process (obmp_quit.h:56) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=21] quit [2025-04-21 14:08:37.858375] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAA-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487775, proxy_sessid=0, client_sessid=3221487775, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.858379] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487777, trace_id:YB420B1D7AB6-00063343B6AEFD90-0-0, sql_handling_stage:10, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.858421] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=12][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.858437] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=15][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.858437] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=48] kill and revert session(conn.sessid_=3221487777, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.858461] WDIAG [SERVER] response (obmp_base.cpp:87) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=23][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.858470] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=30] can close safely, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487777, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:244, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.858487] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=24][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.858491] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAF-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.858508] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858518] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] unlock session of tenant(conn.sessid_=3221487777, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.858527] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD90-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858546] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAB-0-0] [lt=51] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.858564] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.858562] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=35] connection close(sessid=3221487777, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.858636] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAE-0-0] [lt=30] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487774, proxy_sessid=0, client_sessid=3221487774, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.858660] INFO [SERVER] run (obmp_disconnect.cpp:82) [620047][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=39] free session successfully(sessid=3221487777) [2025-04-21 14:08:37.858723] INFO [SERVER] run (obmp_disconnect.cpp:89) [620047][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=61] mark session id unused(sessid=3221487777) [2025-04-21 14:08:37.858828] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAF-0-0] [lt=64] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:37.859019] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD8F-0-0] [lt=28] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215717859014}) [2025-04-21 14:08:37.859026] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8D-0-0] [lt=21] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215717859020}) [2025-04-21 14:08:37.859256] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=17][errcode=0] server close connection(sessid=3221487784, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.859241] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc8004030, session_id:3221487784, trace_id:YB420B1D7AB6-00063343B6AEFD92-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.859288] INFO [SERVER] process (obmp_quit.h:56) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=29] quit [2025-04-21 14:08:37.859275] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDAF-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487785, proxy_sessid=0, client_sessid=3221487785, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.859293] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=45] kill and revert session(conn.sessid_=3221487784, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.859307] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=17][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.859324] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=16][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.859338] WDIAG [SERVER] response (obmp_base.cpp:87) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=14][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.859353] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=13][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.859369] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.859384] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD92-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.859398] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.859716] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAB-0-0] [lt=31] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487782, proxy_sessid=0, client_sessid=3221487782, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.859834] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3bc8004030, session_id:3221487784, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:476, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.859877] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] unlock session of tenant(conn.sessid_=3221487784, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.859898] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] connection close(sessid=3221487784, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD91-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.859955] INFO [SERVER] run (obmp_disconnect.cpp:82) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12] free session successfully(sessid=3221487784) [2025-04-21 14:08:37.859981] INFO [SERVER] run (obmp_disconnect.cpp:89) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] mark session id unused(sessid=3221487784) [2025-04-21 14:08:37.860033] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDAF-0-0] [lt=38] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487786, proxy_sessid=0, client_sessid=3221487786, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:37.860124] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] can close safely, do destroy(*s={this:0x7f3c65b94030, session_id:3221487779, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:219}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:208, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.860168] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=32] unlock session of tenant(conn.sessid_=3221487779, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.860188] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487779, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD94-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.860251] INFO [SERVER] run (obmp_disconnect.cpp:82) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487779) [2025-04-21 14:08:37.860272] INFO [SERVER] run (obmp_disconnect.cpp:89) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487779) [2025-04-21 14:08:37.860257] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8A-0-0] [lt=47][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215717860250}) [2025-04-21 14:08:37.860295] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8A-0-0] [lt=37][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215717860250}) [2025-04-21 14:08:37.860317] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8A-0-0] [lt=20][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215702864017, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.861474] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=22][errcode=0] server close connection(sessid=3221487783, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.861505] INFO [SERVER] process (obmp_quit.h:56) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=29] quit [2025-04-21 14:08:37.861475] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=68][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b98030, session_id:3221487783, trace_id:YB420B1D7AB6-00063343B6AEFD93-0-0, sql_handling_stage:10, sql_initiative_shutdown:true, reader:{fd:223}, err:5, last_decode_time:1745215717861143, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.861519] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=12][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.861540] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=20][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.861534] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=50] kill and revert session(conn.sessid_=3221487783, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.861561] WDIAG [SERVER] response (obmp_base.cpp:87) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=19][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.861562] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] can close safely, do destroy(*s={this:0x7f3c65b98030, session_id:3221487783, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:223}, err:5, last_decode_time:1745215717861143, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.861580] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.861596] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.861615] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD93-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.861611] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] unlock session of tenant(conn.sessid_=3221487783, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.861634] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.861635] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487783, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF0068-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.861708] INFO [SERVER] run (obmp_disconnect.cpp:82) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=32] free session successfully(sessid=3221487783) [2025-04-21 14:08:37.861752] INFO [SERVER] run (obmp_disconnect.cpp:89) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=43] mark session id unused(sessid=3221487783) [2025-04-21 14:08:37.862414] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487774, trace_id:YB420B1D7AB6-00063343B70EFD8E-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:190}, err:5, last_decode_time:1745215717861143, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.862518] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=86] kill and revert session(conn.sessid_=3221487774, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.862526] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=21][errcode=0] server close connection(sessid=3221487774, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.862538] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB3-0-0] [lt=41][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:37.862562] INFO [SERVER] process (obmp_quit.h:56) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=34] quit [2025-04-21 14:08:37.862578] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.862592] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=14][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.862604] WDIAG [SERVER] response (obmp_base.cpp:87) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.862617] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=11][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.862639] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=20][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.862660] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8E-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.862672] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.862740] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD94-0-0] [lt=18] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:37.862824] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620046][T1_L0_G0][T1001][YB420B1D7AB6-00063343B6AEFD94-0-0] [lt=37] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:37.862881] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620046][T1_L0_G0][T1002][YB420B1D7AB6-00063343B6AEFD94-0-0] [lt=34] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:37.864120] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=56][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b96030, session_id:3221487781, trace_id:YB420B1D7AB6-00063343B5BEFDB5-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215717863956, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.864149] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=36][errcode=0] server close connection(sessid=3221487781, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.864185] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=33] quit [2025-04-21 14:08:37.864203] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.864194] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=63] kill and revert session(conn.sessid_=3221487781, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.864224] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=20][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.864243] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.864261] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.864282] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864300] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB5-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864316] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864518] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEB-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717864484, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.864505] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=31] can close safely, do destroy(*s={this:0x7f3c65b96030, session_id:3221487781, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:221}, err:5, last_decode_time:1745215717863956, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.864573] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEB-0-0] [lt=54] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215717857379}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717864484, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.864598] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=73] unlock session of tenant(conn.sessid_=3221487781, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.864621] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEC-0-0] [lt=27] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.864668] INFO [SERVER] run (obmp_disconnect.cpp:82) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=24] free session successfully(sessid=3221487781) [2025-04-21 14:08:37.864637] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=37] connection close(sessid=3221487781, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDB3-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.864717] INFO [SERVER] run (obmp_disconnect.cpp:89) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=47] mark session id unused(sessid=3221487781) [2025-04-21 14:08:37.864728] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=39][errcode=0] server close connection(sessid=3221487778, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.864724] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=77][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487778, trace_id:YB420B1D7AB6-00063343B87EFD8B-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215717863956, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.864764] INFO [SERVER] process (obmp_quit.h:56) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=34] quit [2025-04-21 14:08:37.864771] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487778, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.864787] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=21][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.864808] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=19][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.864827] WDIAG [SERVER] response (obmp_base.cpp:87) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.864847] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.864868] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864895] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8B-0-0] [lt=26][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864878] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=31] can close safely, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487778, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:218}, err:5, last_decode_time:1745215717863956, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.864922] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620062][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.864936] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=42] unlock session of tenant(conn.sessid_=3221487778, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.865027] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=24] free session successfully(sessid=3221487778) [2025-04-21 14:08:37.864968] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] connection close(sessid=3221487778, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B61EFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.865061] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=33] mark session id unused(sessid=3221487778) [2025-04-21 14:08:37.865111] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEC-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865098, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.865141] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEC-0-0] [lt=28] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215717857741}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865098, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.865183] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDED-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865174, sql_renew_time:1745215717865174, is_mark_fail:false}]) [2025-04-21 14:08:37.865207] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDED-0-0] [lt=22] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215717857823}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865174, sql_renew_time:1745215717865174, is_mark_fail:false}]) [2025-04-21 14:08:37.865241] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEE-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865234, sql_renew_time:1745215717865234, is_mark_fail:false}]) [2025-04-21 14:08:37.865263] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEE-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215717857878}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865234, sql_renew_time:1745215717865234, is_mark_fail:false}]) [2025-04-21 14:08:37.865297] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEF-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865290, sql_renew_time:1745215717865290, is_mark_fail:false}]) [2025-04-21 14:08:37.865318] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDEF-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215717857902}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865290, sql_renew_time:1745215717865290, is_mark_fail:false}]) [2025-04-21 14:08:37.865354] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF0-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865345, sql_renew_time:1745215717865345, is_mark_fail:false}]) [2025-04-21 14:08:37.865375] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF0-0-0] [lt=20] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215717857921}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865345, sql_renew_time:1745215717865345, is_mark_fail:false}]) [2025-04-21 14:08:37.865409] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF1-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865402, sql_renew_time:1745215717865402, is_mark_fail:false}]) [2025-04-21 14:08:37.865430] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF1-0-0] [lt=20] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215717857950}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865402, sql_renew_time:1745215717865402, is_mark_fail:false}]) [2025-04-21 14:08:37.865458] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF2-0-0] [lt=21] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.865758] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF2-0-0] [lt=17] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865747, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.865788] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF2-0-0] [lt=29] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215717859014}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865747, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.865821] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF3-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:37.865903] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=41][errcode=0] server close connection(sessid=3221487782, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.865877] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=62][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b96d70, session_id:3221487782, trace_id:YB420B1D7AB6-00063343B4AF006A-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215717865058, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.865935] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=30] quit [2025-04-21 14:08:37.865957] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=21][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.865943] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=58] kill and revert session(conn.sessid_=3221487782, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.865944] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8D-0-0] [lt=42][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:37.865980] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=21][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.866002] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=21][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.865991] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=96][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b98d70, session_id:3221487786, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.866021] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.866043] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=20][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.866038] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487786, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.866063] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006A-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.866082] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.866067] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=28] sock ref clean, do destroy(*s={this:0x7f3c65b98d70, session_id:3221487786, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.866124] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] unlock session of tenant(conn.sessid_=3221487786, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.866139] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=41] can close safely, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487774, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:190}, err:5, last_decode_time:1745215717861143, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:241, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.866192] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487786) [2025-04-21 14:08:37.866157] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] connection close(sessid=3221487786, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF0069-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:37.866196] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=41] unlock session of tenant(conn.sessid_=3221487774, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.866220] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=27] mark session id unused(sessid=3221487786) [2025-04-21 14:08:37.866220] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] connection close(sessid=3221487774, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B64EFD8F-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:24, seq_:30}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:31}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.866280] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=26] free session successfully(sessid=3221487774) [2025-04-21 14:08:37.866304] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487774) [2025-04-21 14:08:37.866350] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF3-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717866340, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.866379] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF3-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215717859020}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717866340, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:37.867578] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:37.867622] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=36] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.867803] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=18][errcode=0] server close connection(sessid=3221487775, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.867833] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=28] quit [2025-04-21 14:08:37.867846] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=12][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.867835] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=48][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487775, trace_id:YB420B1D7AB6-00063343B4AF006B-0-0, sql_handling_stage:10, sql_initiative_shutdown:true, reader:{fd:205}, err:5, last_decode_time:1745215717867195, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.867864] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.867876] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.867874] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] kill and revert session(conn.sessid_=3221487775, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.867895] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.867895] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487775, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:205}, err:5, last_decode_time:1745215717867195, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:798, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.867915] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.867933] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006B-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.867931] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] unlock session of tenant(conn.sessid_=3221487775, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.867952] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.867952] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487775, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.867993] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487775) [2025-04-21 14:08:37.868016] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487775) [2025-04-21 14:08:37.869094] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=84][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc8004d70, session_id:3221487785, trace_id:YB420B1D7AB6-00063343B4AF006C-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215717868263, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.869113] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=17][errcode=0] server close connection(sessid=3221487785, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.869134] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=19] quit [2025-04-21 14:08:37.869136] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] kill and revert session(conn.sessid_=3221487785, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.869146] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=11][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.869176] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=28][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.869194] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.869212] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=16][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.869230] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.869247] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006C-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.869264] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.870457] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA1-0-0] [lt=38][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:37.870699] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=14] can close safely, do destroy(*s={this:0x7f3bc8004d70, session_id:3221487785, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215717868263, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:672, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:37.870745] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=36] unlock session of tenant(conn.sessid_=3221487785, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.870767] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] connection close(sessid=3221487785, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD94-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:37.870817] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487785) [2025-04-21 14:08:37.870852] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487785) [2025-04-21 14:08:37.871861] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=25][errcode=0] server close connection(sessid=3221487780, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:37.871878] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=44][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c65b94d70, session_id:3221487780, trace_id:YB420B1D7AB6-00063343B4AF006D-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215717871465, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.871897] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=34] quit [2025-04-21 14:08:37.871913] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] kill and revert session(conn.sessid_=3221487780, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.871911] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=13][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:37.871937] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=24][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:37.871956] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:37.871975] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:37.871996] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.872016] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006D-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.872034] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:37.872241] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=66] LogLoopThread round_cost_time(us)(round_cost_time=20) [2025-04-21 14:08:37.877879] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=85] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:37.889327] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:37.907178] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487776, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.907281] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=88] kill and revert session(conn.sessid_=3221487776, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:37.907305] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] sock ref clean, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487776, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215717856800, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:37.907343] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] unlock session of tenant(conn.sessid_=3221487776, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:37.907370] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=25] connection close(sessid=3221487776, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD95-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:37.907435] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487776) [2025-04-21 14:08:37.907479] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=41] mark session id unused(sessid=3221487776) [2025-04-21 14:08:37.940000] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:37.947010] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:37.947097] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=76] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:37.982065] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:37.999147] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3647) [2025-04-21 14:08:38.022076] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFDEA-0-0] [lt=75] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:08:38.025211] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65709431}], scn_array=[cnt:1, {val:1745215717851395001, v:0}], curr_size=122, accum_size=2242, time_cost=26034) [2025-04-21 14:08:38.033381] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:38.040089] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=83][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.046126] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=36] can close safely, do destroy(*s={this:0x7f3c65b96d70, session_id:3221487782, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:222}, err:5, last_decode_time:1745215717865058, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:544, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:38.046237] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=88] unlock session of tenant(conn.sessid_=3221487782, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:38.046272] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=32] connection close(sessid=3221487782, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B87EFD8A-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:38.046374] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487782) [2025-04-21 14:08:38.046440] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=64] mark session id unused(sessid=3221487782) [2025-04-21 14:08:38.048455] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006E-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:38.050915] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF006E-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254923601223, cache_obj->added_lc()=false, cache_obj->get_object_id()=658, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:38.067737] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:38.067801] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.094417] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5400000, replace_num=100000) [2025-04-21 14:08:38.094526] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=100] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:38.140172] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=94][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.181754] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=38] ts response task statistics(alloc_count=2382, free_count=1190) [2025-04-21 14:08:38.182897] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:38.217690] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE7-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:38.217750] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE7-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:38.240326] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.252173] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF7B-0-0] [lt=51] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215718251146, can_tenant_elr:true}) [2025-04-21 14:08:38.252581] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2025-04-21 14:08:38.254308] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=25985517, this={dio_aligned_buf:{buf_write_offset:1082, buf_padding_size:3014, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:5239, truncate_used_ts:2146}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=25985024, buf_len=589, total_write_size=75985, total_write_size_after_dio=577536, ob_pwrite_used_ts=1125526, count=122, each_pwrite_cost=9225) [2025-04-21 14:08:38.254377] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2075, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:38.254399] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7774) [2025-04-21 14:08:38.254433] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:38.254404] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=75] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3533) [2025-04-21 14:08:38.254474] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:08:38.254535] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:38.254562] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2256, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:38.254578] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=47, avg_log_submit_to_flush_time=2183, avg_log_submit_to_slide_time=2209) [2025-04-21 14:08:38.254604] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3533, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:38.254676] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7774, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:38.254763] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215718052096000, v:0}, new_max_version={val:1745215718052096000, v:0}, last_min_version={val:1745215717851395000, v:0}, last_max_version={val:1745215717851395000, v:0}, total_time_us=4085, delta_us=202665) [2025-04-21 14:08:38.254777] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=57] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215717680867002, v:0}, min_version={val:1745215717680867002, v:0}, max_version={val:1745215717680867002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:38.271645] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE28-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:38.271713] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE28-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.274939] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=15kB/s, net_out=15kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:38.275025] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:38.275210] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:38.275401] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:38.275546] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12260, [delay/us]:prepare:19, schedule:38, submit:10, rt:1657, total:1725) [2025-04-21 14:08:38.275629] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:38.275699] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12259, [delay/us]: prepare:19, schedule:38, submit:10, device:1657, total:1725) [2025-04-21 14:08:38.275764] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:38.275841] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:682, total:698) [2025-04-21 14:08:38.275924] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:38.275962] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:682, total:698) [2025-04-21 14:08:38.276025] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:38.276054] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:38.294633] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:38.323137] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:08:38.340354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.367737] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:38.367821] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.376408] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:38.376485] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:38.376523] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:38.376546] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:38.376579] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:38.376602] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:38.376625] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:38.376648] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:38.378092] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1644, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:38.378139] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:38.378173] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:38.378173] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1574, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:38.378208] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:38.378227] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:38.378258] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:38.378280] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:38.378313] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1779, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:38.378334] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1731, avg_log_submit_to_slide_time=1745) [2025-04-21 14:08:38.378371] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:38.378406] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:38.378436] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:38.378457] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1709, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:38.378476] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=1683, avg_log_submit_to_slide_time=1700) [2025-04-21 14:08:38.378499] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:38.378534] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:38.378573] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:38.383362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:38.387166] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4005, offset=57888}, end_cursor:ObLogCursor{file_id=3, log_id=4006, offset=58194}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77460050, len:3552, log_data_len:306, seq:4005, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:38.387530] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=54] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:38.387607] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215718181410000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215718181410000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:38.391114] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:38.391167] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7774, avg_group_log_size=647) [2025-04-21 14:08:38.392559] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:38.394118] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=61] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4006, offset=58194}, end_cursor:ObLogCursor{file_id=3, log_id=4007, offset=58491}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77464050, len:3246, log_data_len:297, seq:4006, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:38.394405] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:38.394465] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4B-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215718181410000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215718181410000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:38.399419] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=88] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:38.399558] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=119] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:38.400688] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=79] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4102, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:38.400741] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:38.400770] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3533) [2025-04-21 14:08:38.400822] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:38.400845] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4267, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:38.400864] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=37, avg_log_submit_to_flush_time=4203, avg_log_submit_to_slide_time=4229) [2025-04-21 14:08:38.400899] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:38.401883] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:08:38.401932] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=42] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:38.419343] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:08:38.427624] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:08:38.427666] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:38.427693] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:38.427719] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254922977851, flush_io_finished_ret_:0, flush_io_finished_round_:110, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:38.429247] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:38.440424] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=85][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.447223] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:38.447287] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.475290] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.475371] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.475345] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=60] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.475473] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=74] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:08:38.475630] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.485292] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=44] ====== tenant freeze timer task ====== [2025-04-21 14:08:38.494812] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=93] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:38.513410] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] can close safely, do destroy(*s={this:0x7f3c65b94d70, session_id:3221487780, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:220}, err:5, last_decode_time:1745215717871465, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:659, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:38.513504] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=75] unlock session of tenant(conn.sessid_=3221487780, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:38.513541] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=34] connection close(sessid=3221487780, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA1-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:38.513638] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=41] free session successfully(sessid=3221487780) [2025-04-21 14:08:38.513678] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=38] mark session id unused(sessid=3221487780) [2025-04-21 14:08:38.523202] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF73-0-0] [lt=54] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.082768058776855469e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=404, Throttle Trigger(MB)=242, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.583726289037365405e+02) [2025-04-21 14:08:38.540497] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.542265] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:38.555968] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=48] clear dtl interm result cost(us)(clear_cost=373, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:38.560766] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215718560761, bytes: 4471855, bw: 0.015355 MB/s, add_ts: 1007616, add_bytes: 16223 [2025-04-21 14:08:38.563317] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=23] ====== traversal_flush timer task ====== [2025-04-21 14:08:38.563481] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9B-0-0] [lt=60] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215718181410002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:38.563711] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9B-0-0] [lt=188] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:38.563789] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9B-0-0] [lt=76] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:38.566469] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:08:38.566522] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=42] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:38.567926] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:38.567979] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.570703] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:08:38.578751] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:38.578810] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=50] temporary file module use no blocks [2025-04-21 14:08:38.578829] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:38.578851] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:38.578870] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254923128977, flush_io_finished_ret_:0, flush_io_finished_round_:110, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:38.583837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:38.591042] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:38.602063] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:38.602106] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:38.603825] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:38.603862] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:38.620034] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1745215718620030, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2025-04-21 14:08:38.637313] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:38.638364] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=44] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:38.638431] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=65] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:38.638512] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:38.638742] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=225] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:38.638771] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:38.638801] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215714176938001, v:0}) [2025-04-21 14:08:38.638822] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:38.638849] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:38.638899] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=42] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:38.638926] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:38.638963] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:38.638999] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:38.640000] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:38.640042] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=42] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:38.640100] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:38.640172] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:38.640198] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:38.640222] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:38.640247] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:38.640269] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:38.640294] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:38.640323] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:38.640343] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:38.640569] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.647019] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:38.647163] WDIAG read_multi_row (ob_table_access_helper.h:238) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:38.648788] INFO delete_row (ob_table_access_helper.h:312) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215718647194) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215718647194) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:38.648926] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:38.652552] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] submit log success(service_type_=0, last_id=1745215735197259000, limited_id=1745215735197259000) [2025-04-21 14:08:38.652590] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] submit log with lock success(service_type_=0, last_id=1745215735197259000, limited_id=1745215735197259000) [2025-04-21 14:08:38.652932] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:38.654420] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=20] update id meta(ret=0, service_type=0, limited_id=1745215735197259000, latest_scn={val:1745215718652117002, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:38.654526] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=104] handle submit callback(service_type_=0, success=true, used_ts=1975, log_ts={val:1745215718652117002, v:0}, limited_id=1745215735197259000) [2025-04-21 14:08:38.654557] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=29] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:38.654593] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=35] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:38.655806] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF005F-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1745215718655421000, start_id=1745215718655421000, end_id=1745215718655421001) [2025-04-21 14:08:38.670519] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=73] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:38.670826] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:38.672195] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=46] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:38.672311] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215708742072000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:38.676083] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE26-0-0] [lt=19] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.678286] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=59, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:38.678339] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=52] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=2336, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:38.678356] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:38.678370] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=-443, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:38.678395] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFF88-0-0] [lt=24] [APPLY STAT CB TOTAL TIME](cur_stat_count=20, stat_interval=5000000, avg (count/cost)=1952, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:38.679088] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=36] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745300457074037, last_date_:0, this_date_:0, next_date_:1745300457074037, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:38.679209] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=120] check all tenants(ret=0) [2025-04-21 14:08:38.680545] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE29-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.681897] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2A-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.682541] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=104] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:38.682609] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215718682592], gts:1745215718682379000, latest_srr:[mts=1745215718682592]}) [2025-04-21 14:08:38.683274] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2B-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.684654] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2C-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.685970] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2D-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.686375] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2025-04-21 14:08:38.686427] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=41] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:38.686497] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=43] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:38.687281] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2E-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.690849] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE2F-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.695032] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695109] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:38.695353] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695422] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695618] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695792] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695817] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695868] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695889] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695904] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.695947] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.696491] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=65] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:38.725792] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=82] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:38.740655] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.762407] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9D-0-0] [lt=52] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:38.776678] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:38.776731] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=51] try gc retain ctx [2025-04-21 14:08:38.776748] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:38.776798] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] finish update min start scn(max_decided_scn={val:1745215718181410004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215708670854000, v:0}, keep_alive_scn_:{val:1745215713676177000, v:0}, update_ts_:1745215718775996}) [2025-04-21 14:08:38.777842] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:38.778026] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=104] finish update min start scn(max_decided_scn={val:1745215718181410004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215708670854000, v:0}, keep_alive_scn_:{val:1745215713676177000, v:0}, update_ts_:1745215718777062}) [2025-04-21 14:08:38.778972] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215716111429000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:38.784379] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:38.785328] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] [CACHE] tenant_id= 1 cache memory info: [CACHE] tenant_id= 1 | cache_name= schema_cache | cache_size= 27048960 | cache_store_size= 24969216 | cache_map_size= 2079744 | kv_cnt= 1505 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= vtable_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 37 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 2205 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 6 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= log_kv_cache | cache_size= 70745088 | cache_store_size= 68665344 | cache_map_size= 2079744 | kv_cnt= 1001 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 169 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 49 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:08:38.785406] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] [CACHE] tenant_id= 1001 cache memory info: [CACHE] tenant_id= 1001 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 85 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 85 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 1917 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= log_kv_cache | cache_size= 29129728 | cache_store_size= 27049984 | cache_map_size= 2079744 | kv_cnt= 395 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 83 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:08:38.785471] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] [CACHE] tenant_id= 1002 cache memory info: [CACHE] tenant_id= 1002 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 82 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 83 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= storage_meta_cache | cache_size= 16645120 | cache_store_size= 14565376 | cache_map_size= 2079744 | kv_cnt= 4318 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= log_kv_cache | cache_size= 29129728 | cache_store_size= 27049984 | cache_map_size= 2079744 | kv_cnt= 395 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 93 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:08:38.785514] INFO print_current_status (ob_kvcache_hazard_version.cpp:328) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=17] [KVCACHE-HAZARD] hazard version status info: current_version: 4952 | min_version= 4952 | total_nodes_count: 17 | [KVCACHE-HAZARD] i= 111 | acquire_version=18446744073709551615 | waiting_nodes_count= 15 | last_retire_version= 4935 | [KVCACHE-HAZARD] i= 457 | acquire_version=18446744073709551615 | waiting_nodes_count= 2 | last_retire_version= 4875 | [2025-04-21 14:08:38.787432] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:38.787470] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620324][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF7EFD86-0-0] [lt=13] ObArchiveSender is running(thread_index=2) [2025-04-21 14:08:38.819426] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=72] gc stale ls task succ [2025-04-21 14:08:38.823784] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=62] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:38.823845] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:08:38.823864] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:38.823891] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:38.823914] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254923374019, flush_io_finished_ret_:0, flush_io_finished_round_:110, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:38.829282] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=82] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:38.840734] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:38.841423] INFO [STORAGE] runTimerTask (ob_ddl_heart_beat_task.cpp:49) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=19] send to rs all task status succeed [2025-04-21 14:08:38.853701] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE30-0-0] [lt=34] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:38.853768] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE30-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:38.867949] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:38.868015] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.893239] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:38.895005] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1745215718894315000, start_id=1745215718894315000, end_id=1745215718894315001) [2025-04-21 14:08:38.895240] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:38.909486] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:38.909559] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=71] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:38.910179] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] update_check_range(min_check_version=10, max_check_version=11, global_version=12) [2025-04-21 14:08:38.923602] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=59] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:38.933995] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 164 249 0 1 2 87 1 0 1 4 1 1 0 1 5 43 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 233 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 50 61 0 500 23 21 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 87 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 20 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 92 245 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 23854 [2025-04-21 14:08:38.934069] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,072,775,168 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 460,386,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 90,177,536 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:38.934394] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 460,386,304 used= 384,028,784 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 28 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,767,744 used= 4,194,304 count= 70 avg_used= 59,918 block_cnt= 70 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,150,464 used= 3,020,064 count= 652 avg_used= 4,632 block_cnt= 652 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,374,720 used= 1,301,088 count= 36 avg_used= 36,141 block_cnt= 36 chunk_cnt= 10 mod=CommSysVarFac [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 7 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 601,472 used= 587,264 count= 74 avg_used= 7,936 block_cnt= 74 chunk_cnt= 13 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 378,880 used= 363,520 count= 80 avg_used= 4,544 block_cnt= 80 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 195,072 used= 190,464 count= 24 avg_used= 7,936 block_cnt= 24 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 83,016 count= 9 avg_used= 9,224 block_cnt= 9 chunk_cnt= 6 mod=[T]ObDSActionAr [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 97,536 used= 95,232 count= 12 avg_used= 7,936 block_cnt= 12 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,464 used= 6,144 count= 12 avg_used= 512 block_cnt= 11 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 7,488 used= 5,088 count= 12 avg_used= 424 block_cnt= 12 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,028,784 used= 375,910,124 count= 32,160 avg_used= 11,688 mod=SUMMARY [2025-04-21 14:08:38.934446] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:08:38.934473] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:08:38.934497] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 90,177,536 used= 86,713,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 81,809,536 used= 74,307,679 count= 3,701 avg_used= 20,077 block_cnt= 3,701 chunk_cnt= 43 mod=SqlPhyPlan [MEMORY] hold= 3,484,992 used= 3,278,864 count= 360 avg_used= 9,107 block_cnt= 360 chunk_cnt= 43 mod=SqlPlanCache [MEMORY] hold= 1,416,576 used= 1,291,584 count= 651 avg_used= 1,984 block_cnt= 217 chunk_cnt= 42 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 86,713,088 used= 78,879,727 count= 4,714 avg_used= 16,733 mod=SUMMARY [2025-04-21 14:08:38.934532] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:08:38.934557] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:08:38.934592] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:08:38.934618] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:08:38.934645] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:38.934670] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:38.934707] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:08:38.934739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,699,520 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,828,800 used= 1,785,600 count= 225 avg_used= 7,936 block_cnt= 225 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,699,520 used= 19,627,328 count= 229 avg_used= 85,708 mod=SUMMARY [2025-04-21 14:08:38.934770] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:08:38.934809] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:08:38.934847] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 772,206,592 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 109,858,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 225,513,472 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:38.935135] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,135,744 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:38.947497] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:38.951181] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215718181410004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=769746, in_cluster_service=true, cluster_version={val:1745215718181410003, v:0}, min_cluster_version={val:1745215718181410003, v:0}, max_cluster_version={val:1745215718181410003, v:0}, get_cluster_version_err=0, cluster_version_delta=769746, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=964, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=49826892, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:38.955829] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=36] current monitor number(seq_=-1) [2025-04-21 14:08:38.985975] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=19] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43621990400, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:38.990884] INFO [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:654) [619654][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=42] dump dest keepalive data states, addr: "11.29.122.182:2882", last_write_ts_=1745215718790499, last_read_ts_=1745215718590375, in_black_=0 [2025-04-21 14:08:38.999964] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3660) [2025-04-21 14:08:39.002672] INFO [STORAGE.BLKMGR] mark_macro_blocks (ob_block_manager.cpp:1066) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=68] no block alloc/free, no need to mark blocks(ret=0, mark_info.count()=0) [2025-04-21 14:08:39.002741] INFO [STORAGE.BLKMGR] mark_and_sweep (ob_block_manager.cpp:1046) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=61] finish once mark and sweep(ret=0, alloc_num=9, mark_info.count()=0, marker_status={total_block_count:66560, reserved_block_count:2, linked_block_count:0, tmp_file_count:0, data_block_count:0, shared_data_block_count:12, index_block_count:0, ids_block_count:0, disk_block_count:0, bloomfiter_count:0, hold_count:46, pending_free_count:4, free_count:66512, shared_meta_block_count:34, mark_cost_time:87, sweep_cost_time:0, start_time:"2025-04-21 14:08:39.2647", last_end_time:"2025-04-21 14:07:39.1988", hold_info:nothing, mark_finished:false}, map_cnt=46) [2025-04-21 14:08:39.005780] INFO [SHARE] run1 (ob_dynamic_thread_pool.cpp:594) [619612][qth_mgr][T0][Y0-0000000000000000-0-0] [lt=74] [thread pool stat](pool_stat={pool:0x7f3c901e9480, last_check_time:1745215719005774, last_idle_time:120672999, last_thread_count:1}, *pool={name:IO_SYNC_CH, this:0x7f3c901e9480, min_thread_cnt:1, max_thread_cnt:96, running_thread_cnt:0, threads_idle_time:120672999, tenant_id:500}, qsize=-1, current_idle_time=120672999) [2025-04-21 14:08:39.008849] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=54][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:39.008961] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=33] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:39.008998] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB5-0-0] [lt=18] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:39.009028] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=67] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:39.009052] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB5-0-0] [lt=49] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:39.033546] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=70] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:39.040892] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.052953] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFF7F-0-0] [lt=105] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=402, Holding Memory(MB)=68, Tenant Remain Memory(MB)=558, Usable Remain Memory(MB)=334, Last Update Limit Timestamp=1745215719051997, Is Updated=true) [2025-04-21 14:08:39.055333] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1745215718852356000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65713798}, palf_committed_end_scn_:{val:1745215719053019000, v:0}, last_check_scn_:{val:1745215719053019000, v:0}, max_applied_cb_scn_:{val:1745215718852356000, v:0}}) [2025-04-21 14:08:39.055399] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=57] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65713798}, readable_log_tail:{lsn:65713798}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1390970, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:39.055423] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=28] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:137617842, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:77, recv_lp_rpc_cnt:0, recv_mysql_cnt:961, recv_task_cnt:92, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:347975, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:51, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:102, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:422, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x40e:cnt=9 pcode=0x152:cnt=5, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:08:39.056183] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=758] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:08:39.056535] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0070-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:39.056218] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=34] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:8661621, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:592198, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:08:39.056860] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=640] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:08:39.057343] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:39.057385] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=38] start lib cache evict(tenant_id=1001, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:39.057411] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=153, cache_node_num=153) [2025-04-21 14:08:39.057434] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:39.056883] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=22] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:7193950, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:296038, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:08:39.057536] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=652] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:08:39.057566] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=30] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:42234863, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:96, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:45329, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:410, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:08:39.058307] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=739] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:08:39.058330] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=22] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:68260739, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:536, recv_task_cnt:50, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:44294, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:191, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215681312860}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:798, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=18, token_change_ts:1745215608569663, tenant_role:1}) [2025-04-21 14:08:39.059110] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=778] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:08:39.059250] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0070-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254924609556, cache_obj->added_lc()=false, cache_obj->get_object_id()=659, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:39.060599] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:39.060945] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=343] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:39.068104] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:39.068149] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.095402] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:39.122006] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215718922425000, v:0}, base_version={val:1745215718723428000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215718922425000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215719121908, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:39.126653] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=68] [APPLY STAT CB APPEND COST TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=72, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:39.126738] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=84] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=28404, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:39.126755] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:39.126769] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=-423, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:39.126781] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=30, stat_interval=5000000, avg (count/cost)=28053, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:39.126792] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=121] get_max_applied_scn(scn={val:1745215718922425000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:25991072}, palf_committed_end_scn_:{val:1745215719124327000, v:0}, last_check_scn_:{val:1745215719124327000, v:0}, max_applied_cb_scn_:{val:1745215718922425000, v:0}}) [2025-04-21 14:08:39.126847] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:25991072}, readable_log_tail:{lsn:25991072}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41113696, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:39.140976] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.183179] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=32] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215719183141], gts:1745215719182267000, latest_srr:[mts=1745215719183141]}) [2025-04-21 14:08:39.183485] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=73] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=333, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:39.186516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:39.214797] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=73] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:39.219601] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE8-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:39.219651] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE8-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:39.241067] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.242518] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBA-0-0] [lt=52] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:39.242591] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBA-0-0] [lt=62] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=76) [2025-04-21 14:08:39.253389] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=100] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3661, avg_group_log_size=332) [2025-04-21 14:08:39.255101] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3661) [2025-04-21 14:08:39.255279] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3661, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:39.255327] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1655, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:39.255364] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9651) [2025-04-21 14:08:39.255397] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:39.255402] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215719053019000, v:0}, new_max_version={val:1745215719053019000, v:0}, last_min_version={val:1745215718852356000, v:0}, last_max_version={val:1745215718852356000, v:0}, total_time_us=3842, delta_us=202380) [2025-04-21 14:08:39.255444] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215719053019000, v:0}, min_version={val:1745215719053019000, v:0}, max_version={val:1745215719053019000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:39.255433] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9651) [2025-04-21 14:08:39.255500] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:39.255527] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1809, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:39.255548] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1759, avg_log_submit_to_slide_time=1785) [2025-04-21 14:08:39.255616] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9651, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:39.255694] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=67] get_max_applied_scn(scn={val:1745215718682379003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17327627}, palf_committed_end_scn_:{val:1745215718682379004, v:0}, last_check_scn_:{val:1745215718682379004, v:0}, max_applied_cb_scn_:{val:1745215718682379003, v:0}}) [2025-04-21 14:08:39.255755] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17327627}, readable_log_tail:{lsn:17327627}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49777141, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:39.265463] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=108] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:39.273388] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE29-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:39.273455] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE29-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:39.277139] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:39.277203] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:39.277385] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:39.277574] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:39.277662] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:14, schedule:36, submit:7, rt:1351, total:1408) [2025-04-21 14:08:39.277742] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:39.277806] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:14, schedule:36, submit:7, device:1351, total:1408) [2025-04-21 14:08:39.277862] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:39.277938] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:899, total:917) [2025-04-21 14:08:39.278028] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:39.278069] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:899, total:917) [2025-04-21 14:08:39.278133] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:39.278161] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:39.280703] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=84] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:39.295558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:39.324111] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9651) [2025-04-21 14:08:39.329718] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=56] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:39.341148] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.351564] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=100] get_max_applied_scn(scn={val:1745215718682379004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8739588}, palf_committed_end_scn_:{val:1745215719183293000, v:0}, last_check_scn_:{val:1745215719183293000, v:0}, max_applied_cb_scn_:{val:1745215718682379004, v:0}}) [2025-04-21 14:08:39.351625] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=55] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8739588}, readable_log_tail:{lsn:8739588}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58365180, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:39.368120] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:39.368174] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.377143] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:39.377208] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:39.377243] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:39.377273] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:39.377311] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:39.377341] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:39.377365] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:39.377387] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:39.378899] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1613, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:39.378943] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:39.378983] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:39.378962] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1519, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:39.379008] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:39.379033] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=140, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:39.379026] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:39.379100] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:39.379128] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1752, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:39.379147] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1702, avg_log_submit_to_slide_time=1722) [2025-04-21 14:08:39.379192] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:39.379232] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:39.379272] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:39.379294] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1742, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:39.379313] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1719, avg_log_submit_to_slide_time=1731) [2025-04-21 14:08:39.379337] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:39.379377] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:39.379424] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:39.387023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:39.390072] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620159][T1001_ObXAHbWor][T1001][Y0-0000000000000000-0-0] [lt=44] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:08:39.396493] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=11800000, clean_num=200000) [2025-04-21 14:08:39.398720] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=27] ====== traversal_flush timer task ====== [2025-04-21 14:08:39.398880] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9C-0-0] [lt=51] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215719323171000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:39.399019] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9C-0-0] [lt=132] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:39.399243] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:39.399294] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=37] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:39.399321] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=23) [2025-04-21 14:08:39.400263] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:39.400266] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4007, offset=58491}, end_cursor:ObLogCursor{file_id=3, log_id=4008, offset=58797}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77468050, len:2949, log_data_len:306, seq:4007, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:39.400325] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:39.400669] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:39.400742] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215719183293000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215719183293000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:39.401491] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1555, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:39.401544] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:39.401573] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3661) [2025-04-21 14:08:39.401636] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:39.401662] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1864, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:39.401682] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=160, avg_log_gen_to_submit_time=181, avg_log_submit_to_flush_time=1658, avg_log_submit_to_slide_time=1683) [2025-04-21 14:08:39.401720] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:39.404234] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215719403914000, start_id=1745215719403914000, end_id=1745215719403914001) [2025-04-21 14:08:39.404336] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:39.404378] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9651, avg_group_log_size=643) [2025-04-21 14:08:39.405869] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:39.407343] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4008, offset=58797}, end_cursor:ObLogCursor{file_id=3, log_id=4009, offset=59094}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7746c050, len:2643, log_data_len:297, seq:4008, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:39.407601] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:39.407660] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4C-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215719183293000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215719183293000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:39.419415] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:39.427857] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:39.429438] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=56] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:39.431932] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:39.432893] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:39.432955] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:39.433048] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:39.433154] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:39.433204] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:39.433232] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215711319320001, v:0}) [2025-04-21 14:08:39.433247] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=13] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:39.433269] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:39.433287] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:39.433314] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:39.433332] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:39.433365] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:39.433399] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:39.433420] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:39.441231] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.447608] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:39.447665] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.475194] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=58] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.475324] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.475431] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.475718] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.487997] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=41] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:39.495700] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:39.523939] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF78-0-0] [lt=50] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.058918905258178711e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=402, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.661525253760407850e+02) [2025-04-21 14:08:39.524198] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=71] get number(ret=0, service_type_=0, range=1, base_id=1745215719523153000, start_id=1745215719523153000, end_id=1745215719523153001) [2025-04-21 14:08:39.541315] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.551667] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBD-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:39.568314] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=16] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:39.568413] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1745215719568403, bytes: 4486078, bw: 0.013461 MB/s, add_ts: 1007642, add_bytes: 14223 [2025-04-21 14:08:39.568469] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=134] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.570796] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:39.580879] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFDEA-0-0] [lt=55][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:08:39.591221] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:39.597048] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:39.603192] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:39.603290] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=96][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:39.605850] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:39.605902] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:39.611395] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=173] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:39.611463] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=66] try gc retain ctx [2025-04-21 14:08:39.611483] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=19] try to retry start_working [2025-04-21 14:08:39.611610] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] finish update min start scn(max_decided_scn={val:1745215719523153000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215714322263000, v:0}, keep_alive_scn_:{val:1745215714522539001, v:0}, update_ts_:1745215719610721}) [2025-04-21 14:08:39.612657] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215727945792000, latest_log_ts:{val:1745215711319320001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:39.627659] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215719627653, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2025-04-21 14:08:39.641397] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.652473] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=27] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:39.652559] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=66] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=21) [2025-04-21 14:08:39.653495] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=27] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:39.653571] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=58] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:39.653622] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=47] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:39.653651] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=21) [2025-04-21 14:08:39.654401] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=107] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:39.683748] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1745215719682772000, start_id=1745215719682772000, end_id=1745215719682772001) [2025-04-21 14:08:39.683841] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=69] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:39.683881] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=400, get_gts_with_stc_cnt=58, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=59, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:39.688354] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=24] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:39.688459] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=81] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=23) [2025-04-21 14:08:39.691757] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=15] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:39.691825] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=54] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:39.691851] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=23) [2025-04-21 14:08:39.695437] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695586] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695644] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=93] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695683] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:39.695918] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695960] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695965] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.695989] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.696020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.696020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.696722] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:39.728927] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDDF-0-0] [lt=42] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:39.741537] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:39.741567] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:39.741585] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.787565] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=61] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:39.792960] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDE1-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:39.797615] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=126] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:39.811896] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:39.811944] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:39.819499] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=60] gc stale ls task succ [2025-04-21 14:08:39.829450] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:39.833464] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:08:39.841542] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.855411] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE32-0-0] [lt=29] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:39.855474] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE32-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:39.868263] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:39.868315] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.868527] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=27] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65716624}, readable_log_tail:{lsn:65716624}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1388144, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:39.868663] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=133] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:39.868709] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=20] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:39.879113] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=12, gc_interval=10000000) [2025-04-21 14:08:39.879188] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=42] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:39.879222] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=25] gc_check_member_list_ cost time(ret=0, time_us=66) [2025-04-21 14:08:39.879249] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:39.879276] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:39.879301] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:39.879324] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=24) [2025-04-21 14:08:39.879343] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyHandler start process [2025-04-21 14:08:39.887518] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:39.888770] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:39.888814] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=41] start lib cache evict(tenant_id=1, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:39.888840] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=90177536, mem_limit=268435455, cache_obj_num=326, cache_node_num=325) [2025-04-21 14:08:39.888871] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=30] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:39.890371] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=47] finish to resize log external storage handler(current_ts=1745215719890366, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:39.892104] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=326, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:39.892794] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=686] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:39.896044] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:39.904544] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=38][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:39.904645] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=39][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:39.907755] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDCC-0-0] [lt=33] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:39.914041] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] ls blacklist refresh finish(cost_time=9399) [2025-04-21 14:08:39.914572] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=43] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:39.919787] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDE3-0-0] [lt=49] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:39.919875] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDE5-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:39.926118] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:39.941622] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:39.946362] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=39] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14402, max_lsn:65716624, max_scn:{val:1745215719853403000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65716624}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65716039}, last_submit_end_lsn:{lsn:65716624}, last_submit_log_id:14402, last_submit_log_pid:3, max_flushed_lsn:{lsn:65716039}, max_flushed_end_lsn:{lsn:65716624}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65716624}, last_slide_log_id:14402, last_slide_scn:{val:1745215719853403000, v:0}, last_slide_lsn:{lsn:65716039}, last_slide_end_lsn:{lsn:65716624}, last_slide_log_pid:3, last_slide_log_accum_checksum:4244946537, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14403, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65716624}, readable_log_tail:{lsn:65716624}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1388144, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:39.946643] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=276] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215719856122, last_flushed_end_lsn:{lsn:65716624}}]) [2025-04-21 14:08:39.946669] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14403, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215719856122, last_flushed_end_lsn:{lsn:65716624}}]) [2025-04-21 14:08:39.947767] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:39.947814] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:39.955989] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=52] current monitor number(seq_=-1) [2025-04-21 14:08:39.968431] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:39.998216] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:40.000759] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3533) [2025-04-21 14:08:40.029731] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=62] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:40.033674] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=50] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:40.041678] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.046437] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=49] LogLoopThread round_cost_time(us)(round_cost_time=379) [2025-04-21 14:08:40.049370] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=73] BlockGCTimerTask success(ret=0, cost_time_us=10, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:40.050699] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=545239040, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=528502784, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:40.050820] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=60] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:40.050847] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=174, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:40.050918] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=641425408, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=432316416, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:40.050991] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:40.051010] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=17] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=10, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:40.055666] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:08:40.055726] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=59] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:08:40.062771] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0072-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:40.065065] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0072-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254925615373, cache_obj->added_lc()=false, cache_obj->get_object_id()=660, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:40.067713] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=46] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:08:40.068608] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:40.068658] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.096172] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:40.141751] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.198773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:40.221530] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE9-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:40.221606] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDE9-0-0] [lt=73] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:40.222872] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215719923874000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=298980, in_cluster_service=true, cluster_version={val:1745215719923874000, v:0}, min_cluster_version={val:1745215719923874000, v:0}, max_cluster_version={val:1745215719923874000, v:0}, get_cluster_version_err=0, cluster_version_delta=298980, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=975, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=55043447, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:40.241825] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.254064] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2025-04-21 14:08:40.255718] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3533) [2025-04-21 14:08:40.255843] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1667, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:40.255889] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7887) [2025-04-21 14:08:40.255919] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=70, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:40.255899] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3533, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:40.255946] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7887) [2025-04-21 14:08:40.256016] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:40.256043] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1840, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:40.256074] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1791, avg_log_submit_to_slide_time=1815) [2025-04-21 14:08:40.256099] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215720053214000, v:0}, new_max_version={val:1745215720053214000, v:0}, last_min_version={val:1745215719853403000, v:0}, last_max_version={val:1745215719853403000, v:0}, total_time_us=3611, delta_us=202882) [2025-04-21 14:08:40.256139] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215720053214000, v:0}, min_version={val:1745215720053214000, v:0}, max_version={val:1745215720053214000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:40.256154] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7887, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:40.275157] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE2A-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:40.275220] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE2A-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:40.279294] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:40.279366] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:40.279586] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:40.279806] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:40.279904] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:16, schedule:35, submit:8, rt:1268, total:1328) [2025-04-21 14:08:40.280000] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:40.280075] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:16, schedule:35, submit:8, device:1268, total:1328) [2025-04-21 14:08:40.280149] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:40.280231] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:509, total:529) [2025-04-21 14:08:40.280319] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:40.280366] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:509, total:529) [2025-04-21 14:08:40.280439] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:40.280471] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:40.301233] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5500000, replace_num=100000) [2025-04-21 14:08:40.301280] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:40.322772] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=46] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:40.322970] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] no need to update min/max version(new_version={val:1745215719923874000, v:0}, min_version={val:1745215719923874000, v:0}, max_version={val:1745215719923874000, v:0}) [2025-04-21 14:08:40.324000] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:40.324098] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215711165280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:40.341893] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.348508] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=35] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:40.350023] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215720349956000, start_id=1745215720349956000, end_id=1745215720349956001) [2025-04-21 14:08:40.368434] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:40.368496] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.377926] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:40.377982] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:40.378014] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:40.378041] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:40.378074] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:40.378105] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:40.378127] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:40.378147] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:40.379224] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1622, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:40.379272] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:40.379312] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:40.379333] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:40.379406] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:40.379433] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1753, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:40.379453] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1704, avg_log_submit_to_slide_time=1727) [2025-04-21 14:08:40.379486] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:40.379521] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:40.379709] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1811, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:40.379754] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:40.379793] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:40.379829] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:40.379866] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:40.379889] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1907, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:40.379902] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1886, avg_log_submit_to_slide_time=1897) [2025-04-21 14:08:40.379928] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:40.379958] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:40.399343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=102] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:40.402080] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:40.402126] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:40.411975] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:40.412031] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=6285, avg_group_log_size=523) [2025-04-21 14:08:40.412063] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7887) [2025-04-21 14:08:40.413574] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:40.413625] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4009, offset=59094}, end_cursor:ObLogCursor{file_id=3, log_id=4010, offset=59400}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77470050, len:2346, log_data_len:306, seq:4009, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:40.413974] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4D-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:40.414048] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4D-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215720183848000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215720183848000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:40.419490] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:40.420968] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4010, offset=59400}, end_cursor:ObLogCursor{file_id=3, log_id=4011, offset=59697}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77474050, len:2040, log_data_len:297, seq:4010, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:40.421276] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4D-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:40.421342] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4D-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215720183848000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215720183848000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:40.427999] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:40.428044] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:40.428079] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=31] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:40.428107] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254924978225, flush_io_finished_ret_:0, flush_io_finished_round_:112, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:40.429593] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:40.441966] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.447938] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:40.448009] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.454228] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:40.454290] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:40.455829] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1647, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:40.455883] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:40.455927] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4541) [2025-04-21 14:08:40.455999] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:40.456028] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1807, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:40.456048] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1749, avg_log_submit_to_slide_time=1780) [2025-04-21 14:08:40.456084] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=67, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:40.474893] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=66] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.475007] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.475082] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.475518] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.487035] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:08:40.492943] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=75] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:08:40.501393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:40.542036] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.551065] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=87] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:40.553845] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:40.555049] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:40.555147] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215715562497000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:40.566651] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:40.566708] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=50] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:40.568792] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:40.568846] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.570864] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=57] gc stale ls task succ [2025-04-21 14:08:40.575996] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1745215720575992, bytes: 4498850, bw: 0.012089 MB/s, add_ts: 1007589, add_bytes: 12772 [2025-04-21 14:08:40.579144] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:40.579207] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:08:40.579225] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:40.579253] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:40.579281] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254925129355, flush_io_finished_ret_:0, flush_io_finished_round_:112, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:40.588112] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0073-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:40.590431] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0073-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254926140739, cache_obj->added_lc()=false, cache_obj->get_object_id()=661, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:40.591436] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=67] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:40.591809] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0077-0-0] [lt=41][errcode=-4201] hashtable not init [2025-04-21 14:08:40.591844] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0077-0-0] [lt=34] get cursor info failed(cursor_id=36, get_sessid()=3221487630) [2025-04-21 14:08:40.591987] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215720591049000, start_id=1745215720591049000, end_id=1745215720591049001) [2025-04-21 14:08:40.599883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:40.600162] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash time detail, (compute_wash_size_time=162, refresh_score_time=44, wash_time=0) [2025-04-21 14:08:40.602553] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:40.602597] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:40.604262] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:40.604299] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:40.619950] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=47] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:40.624640] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF7D-0-0] [lt=40] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.059070253372192383e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=402, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.661027924542669325e+02) [2025-04-21 14:08:40.635265] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1745215720635261, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2025-04-21 14:08:40.642147] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.654255] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1745215720654077000, start_id=1745215720654077000, end_id=1745215720654077001) [2025-04-21 14:08:40.663312] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=48][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:40.679735] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17333431, this={dio_aligned_buf:{buf_write_offset:3377, buf_padding_size:719, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2472, truncate_used_ts:918}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17330176, buf_len=122, total_write_size=12499, total_write_size_after_dio=380928, ob_pwrite_used_ts=1119321, count=90, each_pwrite_cost=12436) [2025-04-21 14:08:40.684810] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:40.685123] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=47] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215720685106], gts:1745215720684837000, latest_srr:[mts=1745215720685106]}) [2025-04-21 14:08:40.688023] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:08:40.688072] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62944860, tenant_id=1002) [2025-04-21 14:08:40.688126] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:40.695071] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695109] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695447] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695533] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695562] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695620] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695674] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695721] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.695916] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.696092] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.696807] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:40.701541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:40.720511] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=28] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:40.720556] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=42] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:08:40.720575] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=17] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:40.720596] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=18] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:40.740073] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=59] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:40.742221] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=93][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.787696] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:40.800660] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:40.812292] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:40.819586] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=46] gc stale ls task succ [2025-04-21 14:08:40.824123] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:40.824179] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:40.824199] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:40.824229] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:40.824260] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=30] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254925374366, flush_io_finished_ret_:0, flush_io_finished_round_:112, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:40.829611] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:40.842256] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.856933] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE33-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:40.857018] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE33-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:40.868636] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:40.868709] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.901710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:40.932026] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=45] LogLoopThread round_cost_time(us)(round_cost_time=31) [2025-04-21 14:08:40.942337] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:40.948142] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:40.948197] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:40.956120] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=33] current monitor number(seq_=-1) [2025-04-21 14:08:41.001286] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=90] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:41.001579] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4395) [2025-04-21 14:08:41.003277] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=42] [APPLY STAT CB APPEND COST TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=64, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:41.003329] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=51] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=2237, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:41.003346] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:41.003369] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=22] [APPLY STAT CB EXECUTE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=-497, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:41.003391] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0078-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=1805, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:41.009801] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:41.009840] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=39] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:41.009863] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB6-0-0] [lt=19] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:41.009910] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB6-0-0] [lt=43] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:41.026976] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:41.027688] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=45] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:41.027824] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=39] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:41.033802] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:41.038538] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=24] === Run print tenant memory usage task === [2025-04-21 14:08:41.038618] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=37] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 134,889,472 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 776,400,896 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,721,038,377 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,072,775,168 max_mem_memstore_can_get_now= 2,463,023,104 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,721,038,377 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,353,780 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 545,239,040 max_mem_memstore_can_get_now= 361,768,916 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,721,038,377 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,944,860 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 641,425,408 max_mem_memstore_can_get_now= 314,724,314 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:08:41.038756] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=26] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,180,355,584 total_hold= 3,351,248,896 used= 3,100,459,008 freelists_hold= 79,896,576 total_maps= 1,203 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,866,857,472 divisive_memory_used= 134,889,472 virtual_memory_used= 4,555,489,280 [CHUNK_MGR] 2 MB_CACHE: hold= 31,457,280 free= 15 pushes= 312,857 pops= 312,842 maps= 1,069 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 109 pops= 107 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:08:41.038814] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=31] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:08:41.042413] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.053141] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE2B-0-0] [lt=16] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.055832] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] [COMPACTION DAG STATUS] (start_time=1745215711053022, end_time=1745215721055829, dag_status={}) [2025-04-21 14:08:41.055885] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=49] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.055908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.055933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.055953] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.055972] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.055993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.056014] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.056027] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.056040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:41.056059] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056084] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056124] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056173] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056212] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056251] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056290] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056310] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056349] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056387] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056406] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056427] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056509] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056560] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056580] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056600] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056619] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056639] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056710] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056748] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056767] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056786] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056806] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056825] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056845] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056860] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056918] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056938] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056958] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.056997] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057127] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057146] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057165] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057183] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057203] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057222] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057280] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057298] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057337] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057394] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057414] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:41.057454] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:41.057473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:41.057493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:41.057509] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:41.057527] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:41.057544] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:41.057561] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:41.057578] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:41.057595] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:41.057612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:41.057598] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD90-0-0] [lt=59] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:08:41.057631] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:41.058572] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=40] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745300471149799, last_date_:0, this_date_:0, next_date_:1745300471149799, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:41.058705] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=130] check all tenants(ret=0) [2025-04-21 14:08:41.060013] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE2F-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.061323] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE30-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.062617] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE31-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.063905] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE32-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.065219] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE33-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.066510] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE34-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.067283] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26006044}], scn_array=[cnt:1, {val:1745215721054364000, v:0}], curr_size=589, accum_size=7085, time_cost=12701) [2025-04-21 14:08:41.067350] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65721141}], scn_array=[cnt:1, {val:1745215721054364000, v:0}], curr_size=585, accum_size=3688, time_cost=12691) [2025-04-21 14:08:41.067812] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE35-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.068951] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:41.068998] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.069232] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0079-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.071710] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0079-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254926622017, cache_obj->added_lc()=false, cache_obj->get_object_id()=662, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:41.101908] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=88] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:41.104911] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:41.104986] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=68] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:41.105028] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=38] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=118, cache_node_num=118) [2025-04-21 14:08:41.105055] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=26] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:41.108201] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] Dumping All Cache Objs(alloc_obj_list.count()=118, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}]) [2025-04-21 14:08:41.108482] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=277] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:41.112872] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] success to update min reserved snapshot(reserved_snapshot=1745213911165280000, duration=1800, snapshot_gc_ts=1745215711165280000) [2025-04-21 14:08:41.113778] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:41.114761] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213911165280000) [2025-04-21 14:08:41.115574] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9C-0-0] [lt=45] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=93) [2025-04-21 14:08:41.115819] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] get number(ret=0, service_type_=0, range=1, base_id=1745215721115291000, start_id=1745215721115291000, end_id=1745215721115291001) [2025-04-21 14:08:41.116114] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8745880, this={dio_aligned_buf:{buf_write_offset:1032, buf_padding_size:3064, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2880, truncate_used_ts:1193}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8744960, buf_len=112, total_write_size=12074, total_write_size_after_dio=376832, ob_pwrite_used_ts=1114770, count=89, each_pwrite_cost=12525) [2025-04-21 14:08:41.116401] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=49] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1745213911165280000) [2025-04-21 14:08:41.116448] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] update reserved snapshot finished(cost_ts=3584, reserved_snapshot=1745213911165280000) [2025-04-21 14:08:41.142487] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.156843] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=38] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:08:41.158257] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=48] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:08:41.158300] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=39] no transfer partition job [2025-04-21 14:08:41.158320] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=15] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:08:41.160990] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=25] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:08:41.161070] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=65] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:08:41.161117] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD90-0-0] [lt=40] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:08:41.181496] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215721181018000, start_id=1745215721181018000, end_id=1745215721181018001) [2025-04-21 14:08:41.185343] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=36] ts response task statistics(alloc_count=2454, free_count=1226) [2025-04-21 14:08:41.201822] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:41.222818] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=87] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:41.223256] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEA-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:41.223306] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEA-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:41.242550] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.243188] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBB-0-0] [lt=60] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:41.243244] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBB-0-0] [lt=41] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=58) [2025-04-21 14:08:41.254570] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1745215721253701000, start_id=1745215721253701000, end_id=1745215721253701001) [2025-04-21 14:08:41.254811] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=4395, avg_group_log_size=439) [2025-04-21 14:08:41.256114] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1999, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:41.256163] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8779) [2025-04-21 14:08:41.256208] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:41.256183] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4395) [2025-04-21 14:08:41.256249] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:41.256289] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2207, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:41.256375] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4395, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:41.276620] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE36-0-0] [lt=35] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:41.276682] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE36-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.281549] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:41.281637] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:41.281882] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:41.282181] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:41.282317] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8172, [delay/us]:prepare:14, schedule:40, submit:14, rt:1334, total:1403) [2025-04-21 14:08:41.282406] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:41.282480] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:14, schedule:40, submit:14, device:1334, total:1403) [2025-04-21 14:08:41.282554] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:41.282653] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:528, total:548) [2025-04-21 14:08:41.282754] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:41.282799] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:528, total:548) [2025-04-21 14:08:41.282871] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:41.282909] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:41.302080] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:41.342620] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.368833] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:41.368907] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.378788] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:41.378868] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:08:41.378899] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2449) [2025-04-21 14:08:41.378929] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:41.378963] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:41.378996] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:08:41.379019] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:08:41.379041] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:41.380473] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1474, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:41.380520] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1210) [2025-04-21 14:08:41.380526] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=85] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2012, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:41.380555] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:41.380566] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2449) [2025-04-21 14:08:41.380598] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:41.380610] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1210) [2025-04-21 14:08:41.380692] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:41.380728] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1593, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:41.380743] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1558, avg_log_submit_to_slide_time=1581) [2025-04-21 14:08:41.380795] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:41.380831] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2449) [2025-04-21 14:08:41.380871] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:41.380895] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2178, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:41.380914] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=2134, avg_log_submit_to_slide_time=2147) [2025-04-21 14:08:41.380941] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:41.380983] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1210, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:41.381045] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:41.402408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:41.411609] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=12000000, clean_num=200000) [2025-04-21 14:08:41.412754] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:41.412830] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8779, avg_group_log_size=516) [2025-04-21 14:08:41.412878] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8779) [2025-04-21 14:08:41.414171] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8901) [2025-04-21 14:08:41.414255] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=13, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=2112, avg_log_submit_to_slide_time=2136) [2025-04-21 14:08:41.414293] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:41.414318] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8901, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:41.419563] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:41.425775] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] submit log success(service_type_=0, last_id=1745215737945792000, limited_id=1745215737945792000) [2025-04-21 14:08:41.425810] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] submit log with lock success(service_type_=0, last_id=1745215737945792000, limited_id=1745215737945792000) [2025-04-21 14:08:41.427327] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=69] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4011, offset=59697}, end_cursor:ObLogCursor{file_id=3, log_id=4012, offset=60003}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77478050, len:1743, log_data_len:306, seq:4011, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:41.427453] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=49] update id meta(ret=0, service_type=0, limited_id=1745215737945792000, latest_scn={val:1745215721425646001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:41.427557] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=103] handle submit callback(service_type_=0, success=true, used_ts=1784, log_ts={val:1745215721425646001, v:0}, limited_id=1745215737945792000) [2025-04-21 14:08:41.427584] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=25] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:41.427605] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=21] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:41.427690] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4E-0-0] [lt=28] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:41.427764] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4E-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215721174527001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215721174527001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:41.428244] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:41.428305] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=52] temporary file module use no blocks [2025-04-21 14:08:41.428331] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:41.428358] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:41.428383] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254925978468, flush_io_finished_ret_:0, flush_io_finished_round_:113, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:41.428443] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215721224779000, v:0}, new_max_version={val:1745215721224779000, v:0}, last_min_version={val:1745215721024429000, v:0}, last_max_version={val:1745215721024429000, v:0}, total_time_us=4511, delta_us=203661) [2025-04-21 14:08:41.428490] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215721224779000, v:0}, min_version={val:1745215721224779000, v:0}, max_version={val:1745215721224779000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:41.429745] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:41.434255] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4012, offset=60003}, end_cursor:ObLogCursor{file_id=3, log_id=4013, offset=60300}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7747c050, len:1437, log_data_len:297, seq:4012, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:41.434500] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4E-0-0] [lt=50] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:41.434560] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4E-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215721174527001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215721174527001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:41.442702] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.448289] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:41.448339] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.448764] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=19] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:08:41.448853] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=79] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:08:41.448872] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:08:41.448908] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=33] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:41.451654] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=40] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:08:41.453208] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215721174527001, v:0}, base_version={val:1745215720684837002, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215721174527001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215721453166, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:41.453360] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=41] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:08:41.454902] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=41] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:08:41.454946] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=42] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:08:41.455325] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:41.455388] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:41.456490] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:08:41.456597] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:41.456625] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=25] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:41.456965] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2594, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:41.457028] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:41.457057] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3972) [2025-04-21 14:08:41.457110] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:41.457128] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2736, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:41.457142] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=2689, avg_log_submit_to_slide_time=2712) [2025-04-21 14:08:41.457171] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:41.461122] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:08:41.462664] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=40] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:08:41.462717] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=51] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:08:41.463581] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF007E-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.464062] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=18] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:41.464167] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:41.464195] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:41.464312] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF007F-0-0] [lt=44] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11039, add_timestamp:1745215721464290}) [2025-04-21 14:08:41.464348] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF4-0-0] [lt=23] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11039, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:41.464889] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF4-0-0] [lt=42] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11039, locations=[{table_id:11039, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721464863, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:41.464939] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF4-0-0] [lt=49] success to process renew task(task={tenant_id:1, table_id:11039, add_timestamp:1745215721464290}, locations=[{table_id:11039, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721464863, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:41.466339] WDIAG begin (ob_hashtable.h:954) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8C-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.468689] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:08:41.470248] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=38] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:08:41.470284] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=34] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:08:41.470980] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0083-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.471664] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=20] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:41.471774] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=33] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:41.471800] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=24] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:41.471835] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=23] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:41.471905] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=61] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:08:41.471928] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=20] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:41.471962] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=30] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:08:41.471995] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=31] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:08:41.472018] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:08:41.472035] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:41.472062] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:41.472085] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:08:41.472106] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:08:41.472123] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:41.472152] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:41.472175] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=22] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:08:41.473432] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=17] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:41.473473] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=39] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:41.473490] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:41.473532] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=13] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:08:41.473552] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=20] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:08:41.473567] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=14] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:08:41.473587] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=15] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:08:41.473609] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD92-0-0] [lt=21] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:08:41.475518] WDIAG begin (ob_hashtable.h:954) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8C-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.475606] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.475612] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.475921] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.475982] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.476333] WDIAG [LIB.TIME] str_to_digit_with_date (ob_time_convert.cpp:1928) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=38][errcode=-4219] datetime format too short(ret=-4219, str=0) [2025-04-21 14:08:41.476373] WDIAG [LIB.TIME] str_to_ob_time_with_date (ob_time_convert.cpp:1990) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=38][errcode=-4219] failed to get digits(ret=-4219, str=0) [2025-04-21 14:08:41.476390] WDIAG [LIB.TIME] str_to_datetime (ob_time_convert.cpp:398) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=16][errcode=-4219] failed to convert string to datetime(ret=-4219) [2025-04-21 14:08:41.476444] WDIAG [LIB.TIME] str_to_digit_with_date (ob_time_convert.cpp:1928) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=28][errcode=-4219] datetime format too short(ret=-4219, str=0) [2025-04-21 14:08:41.476458] WDIAG [LIB.TIME] str_to_ob_time_with_date (ob_time_convert.cpp:1990) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=13][errcode=-4219] failed to get digits(ret=-4219, str=0) [2025-04-21 14:08:41.476469] WDIAG [LIB.TIME] str_to_datetime (ob_time_convert.cpp:398) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0086-0-0] [lt=11][errcode=-4219] failed to convert string to datetime(ret=-4219) [2025-04-21 14:08:41.478031] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0088-0-0] [lt=10][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.478640] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0089-0-0] [lt=31] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11001, add_timestamp:1745215721478622}) [2025-04-21 14:08:41.479867] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF008B-0-0] [lt=60][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.480859] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF5-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11001, vtable_type={tenant_id:1, type:2}) [2025-04-21 14:08:41.481354] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF8F-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.481719] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF5-0-0] [lt=43] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11001, locations=[{table_id:11001, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721481695, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:41.481767] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF5-0-0] [lt=46] success to process renew task(task={tenant_id:1, table_id:11001, add_timestamp:1745215721478622}, locations=[{table_id:11001, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721481695, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:41.481919] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF90-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.484325] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF92-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.484782] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF93-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.487209] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF008F-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.491680] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0092-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.499169] WDIAG begin (ob_hashtable.h:954) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB6-0-0] [lt=14][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.499874] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB7-0-0] [lt=45] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12095, add_timestamp:1745215721499853}) [2025-04-21 14:08:41.499945] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB7-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12450, add_timestamp:1745215721499940}) [2025-04-21 14:08:41.499936] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF6-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12095, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721499909, sql_renew_time:1745215721499909, is_mark_fail:false}]) [2025-04-21 14:08:41.499995] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF6-0-0] [lt=58] success to process renew task(task={tenant_id:1, table_id:12095, add_timestamp:1745215721499853}, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721499909, sql_renew_time:1745215721499909, is_mark_fail:false}]) [2025-04-21 14:08:41.500045] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF7-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12450, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721500037, sql_renew_time:1745215721500037, is_mark_fail:false}]) [2025-04-21 14:08:41.500071] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF7-0-0] [lt=25] success to process renew task(task={tenant_id:1, table_id:12450, add_timestamp:1745215721499940}, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215721500037, sql_renew_time:1745215721500037, is_mark_fail:false}]) [2025-04-21 14:08:41.502217] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:41.506781] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF94-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.506991] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD8F-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.512086] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF96-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.527119] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF98-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.533691] WDIAG begin (ob_hashtable.h:954) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8B-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.536561] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.536702] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.537467] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=29][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200076}, ls_id={id:-1}) [2025-04-21 14:08:41.537467] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=37][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200076}, ls_id={id:-1}) [2025-04-21 14:08:41.537503] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=35][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:41.537503] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=34][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:41.538479] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.539107] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=14] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200076}}, ls_id:{id:1001}, renew_time:1745215721539011, transfer_seq:0}) [2025-04-21 14:08:41.539172] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=14] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200076}}, ls_id:{id:1001}, renew_time:1745215721539011, transfer_seq:0}) [2025-04-21 14:08:41.540587] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=26] LOCATION: block refresh table cache succ(tablet_id={id:200076}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215721540576, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:41.540612] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=28] LOCATION: block refresh table cache succ(tablet_id={id:200076}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215721540606, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:41.541892] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=55] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200076}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094355656000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.544005] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=35] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846993}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094355656000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.544935] WDIAG [SQL.PC] erase_cache_obj (ob_lib_cache_object_manager.cpp:111) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=31][errcode=-4201] failed to erase cache obj(ret=-4201, id=262) [2025-04-21 14:08:41.544978] WDIAG [SQL.PC] remove_cache_obj_stat_entry (ob_plan_cache.cpp:1851) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=43][errcode=-4201] failed to erase plan statistic entry(ret=-4201, cache_obj_id=262) [2025-04-21 14:08:41.544995] WDIAG [SQL.PC] remove_all_plan_stat (ob_i_lib_cache_node.cpp:77) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=15][errcode=-4201] failed to remove plan stat(obj->get_object_id()=262, ret=-4201) [2025-04-21 14:08:41.545050] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=76] has identical pcv(is_same=true, pcv=0x7f3bd1a8e670) [2025-04-21 14:08:41.545104] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=39][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:08:41.545127] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=20][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f4ccc20, obj=0x7f3bd87a2050) [2025-04-21 14:08:41.545154] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=52][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.545191] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9B-0-0] [lt=31] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846993}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.545252] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=62] has identical pcv(is_same=true, pcv=0x7f3bd1a8e670) [2025-04-21 14:08:41.545287] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=23][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:08:41.545303] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD90-0-0] [lt=14][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f44ec20, obj=0x7f3bd1a56050) [2025-04-21 14:08:41.545411] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.545450] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8D-0-0] [lt=16][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254927095757, cache_obj->added_lc()=false, cache_obj->get_object_id()=264, cache_obj->get_tenant_id()=1002, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:41.546107] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=17][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200079}, ls_id={id:-1}) [2025-04-21 14:08:41.546159] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=49][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:41.547065] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD91-0-0] [lt=15][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.547065] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9C-0-0] [lt=22][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.547318] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9D-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.547781] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=17] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200079}}, ls_id:{id:1001}, renew_time:1745215721547705, transfer_seq:0}) [2025-04-21 14:08:41.549345] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=47] LOCATION: block refresh table cache succ(tablet_id={id:200079}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215721549335, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:41.550113] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9E-0-0] [lt=28][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200074}, ls_id={id:-1}) [2025-04-21 14:08:41.550155] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9E-0-0] [lt=40][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:41.550381] WDIAG begin (ob_hashtable.h:954) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB8-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.550771] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=53] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200079}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.551700] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9E-0-0] [lt=21] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200074}}, ls_id:{id:1001}, renew_time:1745215721551625, transfer_seq:0}) [2025-04-21 14:08:41.552450] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=48] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846998}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.553140] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFF9E-0-0] [lt=45] LOCATION: block refresh table cache succ(tablet_id={id:200074}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215721553130, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:41.553251] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=45][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.553296] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD89-0-0] [lt=38] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846998}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.555082] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDB9-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=48, bitmap=NULL) [2025-04-21 14:08:41.556944] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBE-0-0] [lt=54] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:41.569178] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:41.569263] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.576042] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:41.579441] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:41.579498] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:41.579523] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:41.579550] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:41.579580] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254926129639, flush_io_finished_ret_:0, flush_io_finished_round_:113, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:41.583132] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0097-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.583629] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215721583625, bytes: 4514059, bw: 0.014395 MB/s, add_ts: 1007633, add_bytes: 15209 [2025-04-21 14:08:41.584854] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA1-0-0] [lt=114][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.587440] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0098-0-0] [lt=60][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.587893] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA2-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.589985] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0098-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254927140292, cache_obj->added_lc()=false, cache_obj->get_object_id()=663, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:41.591619] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:41.593874] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDBA-0-0] [lt=54][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=48, bitmap=NULL) [2025-04-21 14:08:41.597415] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA3-0-0] [lt=40][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200075}, ls_id={id:-1}) [2025-04-21 14:08:41.597465] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA3-0-0] [lt=48][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:41.598878] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA3-0-0] [lt=15] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200075}}, ls_id:{id:1001}, renew_time:1745215721598814, transfer_seq:0}) [2025-04-21 14:08:41.600450] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA3-0-0] [lt=45] LOCATION: block refresh table cache succ(tablet_id={id:200075}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215721600439, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:41.602743] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:41.602788] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:41.605472] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:41.605517] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:41.607144] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:41.612116] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:41.625854] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF82-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.059221649169921875e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=402, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.660530485069236875e+02) [2025-04-21 14:08:41.628418] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF009B-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.635340] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF009E-0-0] [lt=53][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.641986] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00A1-0-0] [lt=57][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.642906] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215721642902, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007641, add_bytes: 0 [2025-04-21 14:08:41.645309] WDIAG begin (ob_hashtable.h:954) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDBB-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.646252] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.652095] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00A4-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.654850] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215721654658000, start_id=1745215721654658000, end_id=1745215721654658001) [2025-04-21 14:08:41.657056] WDIAG begin (ob_hashtable.h:954) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8C-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.657828] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=49][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.657876] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=40] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200079}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.657979] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=26] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846999}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.658063] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=38][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.658089] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=23] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606846999}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.658140] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=21] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606847000}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.658206] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=26][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.658231] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=22] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606847000}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.658281] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=22] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606847001}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.658348] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=26][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.658373] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=21] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606847001}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.658426] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=24] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606847002}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214095090123000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.658483] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=17][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.658508] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD93-0-0] [lt=21] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606847002}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.662064] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA6-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.665092] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00A9-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.666650] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFA9-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215721666442000, start_id=1745215721666442000, end_id=1745215721666442001) [2025-04-21 14:08:41.668343] WDIAG begin (ob_hashtable.h:954) [620059][T1_L0_G0][T1][YB420B1D7AB6-00063343B81EFD87-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.669908] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAA-0-0] [lt=62][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.678210] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:41.679549] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=51] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:41.679662] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215718754591000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:41.681764] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=28][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.681815] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=41] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200076}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.681917] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=31] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846991}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094355656000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.682023] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=40][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.682056] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606846991}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.682127] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846992}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094355656000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.682212] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=31][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.682245] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606846992}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.682333] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=28] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846994}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094355656000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:41.682585] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=190][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:41.682617] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAB-0-0] [lt=25] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606846994}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:41.685865] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:41.685933] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215721685915], gts:1745215721685731000, latest_srr:[mts=1745215721685915]}) [2025-04-21 14:08:41.695554] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695657] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695616] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695673] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695701] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695731] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695742] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695776] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=60] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.695971] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.696171] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.696912] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:41.702349] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:41.711814] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFAE-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:41.746320] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.787830] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=60] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:41.804121] INFO [STORAGE.COMPACTION] schedule_all_tablets_minor (ob_tenant_tablet_scheduler.cpp:579) [619990][T1_MergeLoop][T1][YB420B1D7AB6-00063343B99EFD86-0-0] [lt=23] start schedule all tablet minor merge(minor_ls_tablet_iter_={ls_idx:-1, ls_ids:[{id:1}], tablet_ids:{tablet_idx:0, tablet_cnt:0, array:[], is_inited:false}, schedule_tablet_cnt:0, max_batch_tablet_cnt:50000}) [2025-04-21 14:08:41.805766] INFO [STORAGE.COMPACTION] schedule_all_tablets_medium (ob_tenant_tablet_scheduler.cpp:1585) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8B-0-0] [lt=40] start schedule all tablet merge(merge_version=1) [2025-04-21 14:08:41.805864] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [619992][T1_CompactionRe][T1][YB420B1D7AB6-00063343B7AEFD89-0-0] [lt=36] InfoPoolResizeTask(cost_ts=12) [2025-04-21 14:08:41.808692] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:08:41.808789] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9D-0-0] [lt=39] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:41.808914] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9D-0-0] [lt=118] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:41.812201] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:08:41.812249] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:41.812648] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:41.813030] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:41.819654] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:08:41.819878] INFO [ARCHIVE] do_thread_task_ (ob_archive_timer.cpp:130) [619988][T1_ArcTimer][T1][YB420B1D7AB6-00063343AC8EFD86-0-0] [lt=40] archive round not in doing status, just skip(key={incarnation:-1, dest_id:-1, round:-1}, state={status:"INVALID"}) [2025-04-21 14:08:41.824384] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:41.824434] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:41.824452] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:41.824479] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:41.824506] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254926374623, flush_io_finished_ret_:0, flush_io_finished_round_:113, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:41.829786] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:41.833814] INFO [ARCHIVE] produce_log_fetch_task_ (ob_archive_sequencer.cpp:171) [619985][T1_ArcSeq][T1][YB420B1D7AB6-00063343AC5EFD86-0-0] [lt=24] archive round not in doing status, just skip(key={incarnation:-1, dest_id:-1, round:-1}, state={status:"INVALID"}) [2025-04-21 14:08:41.835871] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=31] ====== tenant freeze timer task ====== [2025-04-21 14:08:41.838241] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:41.839201] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:41.839263] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=61] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:41.839331] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:41.839432] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=96] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:41.839478] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:41.839500] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=0, rec_log_ts={val:1745215718652117002, v:0}) [2025-04-21 14:08:41.839522] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:41.839542] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:41.839568] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:41.839604] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:41.839628] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:41.839661] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:41.839696] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:41.839719] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:41.845202] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=53] clear dtl interm result cost(us)(clear_cost=3012, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:41.846388] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.858823] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE34-0-0] [lt=26] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:41.858904] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE34-0-0] [lt=78] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:41.869057] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:41.869131] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.870113] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:81) [619990][T1_MergeLoop][T1][YB420B1D7AB6-00063343B99EFD86-0-0] [lt=82] MergeLoopTask(cost_ts=66027) [2025-04-21 14:08:41.896242] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:41.896382] WDIAG read_multi_row (ob_table_access_helper.h:238) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=55][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:41.898033] INFO delete_row (ob_table_access_helper.h:312) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=32] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215721896415) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215721896415) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:41.902324] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:41.902479] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:41.922847] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=38] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:41.923742] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=52] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:41.946432] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:41.948480] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:41.948535] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:41.994589] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=41] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:08:42.004941] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:42.013165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:42.024439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=28] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000) [2025-04-21 14:08:42.024490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=49] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024563] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.024990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=41] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.025952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026014] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.026950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.027949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028018] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.028947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029517] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.029975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.030995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.031933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.032992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.033944] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:42.034009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846986}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846977}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.034948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035799] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.035996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.036970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037387] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.037937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846980}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.038943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.039945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101017}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.040984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.041938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.042947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.043933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.044947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.045972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046106] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=14] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046510] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.046560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.046991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047106] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:200010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.047961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:200006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.048947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.049945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846979}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.050968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.051988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.052980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846988}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.053987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054583] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.054956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.055942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.056984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.057952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.058946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059010] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:200012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059272] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.059947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.060933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.061956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846985}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846978}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062697] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101016}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.062966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846993}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.063953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064686] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.064950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065496] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.065948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066018] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.066939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.067991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101015}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.068987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069373] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=2, size_used=0, mem_used=2079744) [2025-04-21 14:08:42.069444] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.069483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.069948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.070998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.071988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.072973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073651] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846987}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.073977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.074969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075704] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00AC-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.075772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.075969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.076954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077558] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077818] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.077948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078250] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00AC-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254927628554, cache_obj->added_lc()=false, cache_obj->get_object_id()=664, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:42.078282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846981}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.078970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.079958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.080963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.081976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846996}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.082973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846991}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.083952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.084997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.085942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846982}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846984}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.086997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.087974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088106] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846989}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.088960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846992}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.089970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:200003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.090961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.091025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213915562497000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213905554947000, max_merged_snapshot=1) [2025-04-21 14:08:42.091091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=21] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:08:42.094364] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD89-0-0] [lt=3] SSTableGCTask(cost_ts=70185) [2025-04-21 14:08:42.102607] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:42.104971] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:42.105045] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=71] try gc retain ctx [2025-04-21 14:08:42.105062] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:08:42.105124] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215722055322000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215711920278001, v:0}, keep_alive_scn_:{val:1745215717050405001, v:0}, update_ts_:1745215722104220}) [2025-04-21 14:08:42.106159] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:42.124506] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=79] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215722025431000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215722124434}, version_delta=99070) [2025-04-21 14:08:42.146579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.154020] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=17] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215721855167000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=298842, in_cluster_service=true, cluster_version={val:1745215721855167000, v:0}, min_cluster_version={val:1745215721855167000, v:0}, max_cluster_version={val:1745215721855167000, v:0}, get_cluster_version_err=0, cluster_version_delta=298842, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1023, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=59684146, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:42.186486] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=429, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:42.186549] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=61] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215722186451], gts:1745215722185961000, latest_srr:[mts=1745215722186451]}) [2025-04-21 14:08:42.213718] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:42.225194] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEB-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:42.225256] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEB-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:42.228210] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=62] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:42.246673] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.254107] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=76] no need to update min/max version(new_version={val:1745215721855167000, v:0}, min_version={val:1745215721855167000, v:0}, max_version={val:1745215721855167000, v:0}) [2025-04-21 14:08:42.261402] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1329, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:42.261455] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8513) [2025-04-21 14:08:42.261491] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:42.261577] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:42.261623] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1559, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:42.278966] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE38-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:42.279045] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE38-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:42.286254] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:42.286372] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=95] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:42.286481] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS GROUP SYS](tenant_id=1, io_status=sys_group_name:SSTABLE_WHOLE_SCANNER_IO, mode:LOCAL READ, cur_req:1, hold_mem:8192 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:713, bw:2918938, [delay/us]:prepare:3, schedule:36, submit:11, rt:481, total:532) [2025-04-21 14:08:42.286553] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=1, ref_cnt=4, io_config={group_configs_cnt:3, memory_limit_:2147483648, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:3, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:3}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28633536, free_req_cnt=49999, free_result_cnt=49999, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=178, ops=0, iops=178, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:42.286624] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS FUNCTION](tenant_id=1, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:713, avg_bw:2918668, [delay/us]: prepare:3, schedule:36, submit:11, device:481, total:532) [2025-04-21 14:08:42.286703] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:42.286892] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:42.286989] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8153, [delay/us]:prepare:15, schedule:51, submit:10, rt:1155, total:1232) [2025-04-21 14:08:42.287059] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:42.287097] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8154, [delay/us]: prepare:15, schedule:51, submit:10, device:1155, total:1232) [2025-04-21 14:08:42.287151] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:42.287222] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4077, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:782, total:799) [2025-04-21 14:08:42.287299] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:42.287334] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4077, [delay/us]: prepare:0, schedule:0, submit:600000000, device:782, total:799) [2025-04-21 14:08:42.287395] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:42.287418] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=1, async_total=0, sync_cnt= 0 0 0 0 0 0 0 1, async_cnt= 0 [2025-04-21 14:08:42.302760] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:42.305179] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=111] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3185, avg_group_log_size=289) [2025-04-21 14:08:42.306472] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3185) [2025-04-21 14:08:42.306647] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3185, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:42.346797] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=91][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.369249] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:172) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:08:42.369315] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=63] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:42.369344] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.379581] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:42.379640] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=2304, avg_group_log_size=230) [2025-04-21 14:08:42.379678] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2304) [2025-04-21 14:08:42.379707] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:42.379741] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:42.379768] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=4166, avg_group_log_size=416) [2025-04-21 14:08:42.379790] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4166) [2025-04-21 14:08:42.379810] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:42.381217] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1518, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:42.381268] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1902, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:42.381301] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2304) [2025-04-21 14:08:42.381310] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4166) [2025-04-21 14:08:42.381340] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=263, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:42.381367] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=111, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:42.381360] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2304) [2025-04-21 14:08:42.381419] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:42.381439] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1943, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:42.381454] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1890, avg_log_submit_to_slide_time=1913) [2025-04-21 14:08:42.381499] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:42.381528] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=4166) [2025-04-21 14:08:42.381531] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2304, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:42.381553] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:42.381573] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2117, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:42.381585] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=2092, avg_log_submit_to_slide_time=2104) [2025-04-21 14:08:42.381609] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:42.381618] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=4166, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:42.402270] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:42.402321] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=45] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:42.413449] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:42.414253] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43619893248, global_cache_size=249692160, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:42.414928] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8513) [2025-04-21 14:08:42.414997] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=91, avg_log_gen_to_submit_time=108, avg_log_submit_to_flush_time=1431, avg_log_submit_to_slide_time=1453) [2025-04-21 14:08:42.415029] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:42.415071] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8513, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:42.419643] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:42.426552] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=9102, avg_group_log_size=479) [2025-04-21 14:08:42.426595] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8635) [2025-04-21 14:08:42.429894] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:42.443363] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4013, offset=60300}, end_cursor:ObLogCursor{file_id=3, log_id=4014, offset=60606}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77480050, len:1140, log_data_len:306, seq:4013, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:42.443731] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4F-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:42.443806] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4F-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215722185961000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215722185961000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:42.446886] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.448656] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:42.448704] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.450037] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=60] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4014, offset=60606}, end_cursor:ObLogCursor{file_id=3, log_id=4015, offset=60903}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77484050, len:834, log_data_len:297, seq:4014, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:42.450308] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4F-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:42.450365] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE4F-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215722185961000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215722185961000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:42.460814] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=68] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215721704170003, v:0}, new_max_version={val:1745215721704170003, v:0}, last_min_version={val:1745215721704170001, v:0}, last_max_version={val:1745215721704170001, v:0}, total_time_us=3390, delta_us=756639) [2025-04-21 14:08:42.460881] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=64] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215721704170003, v:0}, min_version={val:1745215721704170003, v:0}, max_version={val:1745215721704170003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:42.475258] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.475678] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.475693] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.475743] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.489353] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45] ====== tenant freeze timer task ====== [2025-04-21 14:08:42.505314] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:42.505390] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:42.506705] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1570, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:42.506766] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:42.506819] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3185) [2025-04-21 14:08:42.506923] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=72] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:42.506954] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1726, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:42.506977] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1672, avg_log_submit_to_slide_time=1699) [2025-04-21 14:08:42.507026] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:42.508209] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5600000, replace_num=100000) [2025-04-21 14:08:42.508258] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:42.515592] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=70] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:08:42.544630] INFO [STORAGE.COMPACTION] add_event_and_diagnose (ob_medium_loop.cpp:203) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8B-0-0] [lt=43] finish schedule all tablet merge(merge_version_=1, schedule_stats_={all_ls_weak_read_ts_ready:true, start_timestamp:0}, loop_cnt=0, tenant_merge_finish=true, is_scan_all_tablet_finish=true, schedule_tablet_cnt={schedule_dag_cnt:0, submit_clog_cnt:0, finish_cnt:1072, loop_tablet_cnt:1072, force_freeze_cnt:0, wait_rs_validate_cnt:0}, time_guard=GET_TABLET=20.00ms|INIT_TABLET_STATUS=68.86ms|SCHEDULE_NEXT_MEDIUM=5.71ms|SCHEDULE_TABLET_EXECUTE=644.23ms|) [2025-04-21 14:08:42.544747] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:95) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8B-0-0] [lt=110] MediumLoopTask(cost_ts=739015) [2025-04-21 14:08:42.544794] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8C-0-0] [lt=23] MediumCheckTask(cost_ts=12) [2025-04-21 14:08:42.546958] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.548894] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB0-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.548999] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD8E-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.549054] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD94-0-0] [lt=20][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.551521] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB2-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.551673] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD96-0-0] [lt=72][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.551688] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD90-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.561425] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB4-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.562061] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB5-0-0] [lt=54][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.565587] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=82] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:42.566783] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:08:42.566833] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=37] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:42.569593] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:42.569641] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.576124] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:08:42.589077] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=40] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:331}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214062062637000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.591252] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215722591247, bytes: 4526831, bw: 0.012088 MB/s, add_ts: 1007622, add_bytes: 12772 [2025-04-21 14:08:42.591406] INFO [COMMON] handle (ob_io_struct.cpp:2969) [620264][T1002_DiskCB0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=101] callback runner call handle(get_queue_count()=0, req={is_inited_:true, tenant_id_:1002, control_block_:0x7f3c91a84ba8, ref_cnt_:1, raw_buf_:0x7f3bdc9ac150, fd_:{first_id:1152921504606849042, second_id:2067, third_id:0, fd_id:-1, slot_version:-1, device_handle:0x7f3c91a4a080}, trace_id_:YB420B1D7AB6-00063343B76EFFB6-0-0, retry_count_:0, tenant_io_mgr_:{ptr:0x7f3c3afe6030}, storage_accesser:{ptr:null}, io_result_:{is_inited_:true, is_finished_:false, is_canceled_:false, has_estimated_:false, complete_size_:4096, offset_:2065020, size_:293, timeout_us_:10000000, result_ref_cnt_:2, out_ref_cnt_:1, flag_:{mode:"READ", group_id_:0, func_type_:0, wait_event_id_:1, is_sync_:false, is_unlimited_:false, is_detect_:false, is_write_through_:false, is_sealed_:true, is_time_detect_:false, need_close_dev_and_fd_:false, reserved_:0}, ret_code_:{io_ret_:0, fs_errno_:0}, tenant_id_:1002, tenant_io_mgr_:{ptr:0x7f3c3afe6030}, user_data_buf_:null, buf_:null, io_callback_:0x7f3bdc99c080, time_log:{begin_ts:1745215722590280, enqueue_used:8, dequeue_used:37, submit_used:17, return_used:1021, callback_enqueue_used:6, callback_dequeue_used:33, callback_finish_used:-1, end_used:-1}}, part_id:-1}) [2025-04-21 14:08:42.591747] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD97-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.591851] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:42.592385] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=63] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:331}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.595286] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0xe5af417 0x77c4cd0 0x77b7d5a 0x77b7c6f 0x77a83e6 0x77a8102 0x182b83f0 0x1821dd54 0xddeb85a 0x134bf58d 0x134be61d 0x130c3adb 0x130c11e7 0x7b4307b 0x7b3f44e 0x131af40c 0x79c0e9d 0x1214a4d7 0x7d73e31 0x12106a83 0x7ad6ff8 0x7ad6b14 0x7abfdee 0x79fffee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.597351] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=36] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:336}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214062062637000, delete_commit_version:-1}, snapshot_version=1745215722185961000) [2025-04-21 14:08:42.598562] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD99-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.599470] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=50] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:336}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.600568] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:42.600637] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=51] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=23) [2025-04-21 14:08:42.600928] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9A-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.601391] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0xe5af417 0x77c4cd0 0x77b7d5a 0x77b7c6f 0x77a83e6 0x77a8102 0x182b83f0 0x1821dd90 0xddeb85a 0x134bf58d 0x134be61d 0x130c3adb 0x130c11e7 0x7b4307b 0x7b3f44e 0x131af40c 0x79c0e9d 0x1214a4d7 0x7d73e31 0x12106a83 0x7ad6ff8 0x7ad6b14 0x7abfdee 0x79fffee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.602849] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=34] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:335}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214062062637000, delete_commit_version:-1}, snapshot_version=1745215722185961000) [2025-04-21 14:08:42.602912] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9B-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.603520] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:42.603568] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:42.604513] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=46] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:335}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.605588] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:42.605614] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:42.607485] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=30][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200078}, ls_id={id:-1}) [2025-04-21 14:08:42.607532] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=45][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:42.608961] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=16] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200078}}, ls_id:{id:1001}, renew_time:1745215722608900, transfer_seq:0}) [2025-04-21 14:08:42.610396] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=62] LOCATION: block refresh table cache succ(tablet_id={id:200078}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215722610386, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:42.611669] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=49] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200078}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094750195002, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.614854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43611504640, global_cache_size=251772928, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:42.616147] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9D-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.620217] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=43][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.620265] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB6-0-0] [lt=42] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:200078}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.624368] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26020024}], scn_array=[cnt:1, {val:1745215722459015001, v:0}], curr_size=122, accum_size=3306, time_cost=10709) [2025-04-21 14:08:42.627016] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF87-0-0] [lt=18] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.059221649169921875e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=402, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.660530485069236875e+02) [2025-04-21 14:08:42.631828] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=39] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846996}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094750195002, delete_commit_version:-1}, snapshot_version=1745215722185961000) [2025-04-21 14:08:42.631985] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=54][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.632023] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=31] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846996}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.647035] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.648225] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB7-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.648904] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFB8-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.650518] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215722650511, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2025-04-21 14:08:42.650974] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=25] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846997}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094750195002, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.651700] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=60][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.651746] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9E-0-0] [lt=39] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846997}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.657034] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=28] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:42.657093] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=56] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:08:42.657113] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:42.657130] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=13] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:42.661463] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=84] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:42.665268] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=27] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26021324}, readable_log_tail:{lsn:26021324}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41083444, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:42.665450] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=180] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:08:42.665506] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=26] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:42.682562] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] [COMPACTION DAG STATUS] (start_time=1745215712679596, end_time=1745215722682556, dag_status={}) [2025-04-21 14:08:42.682637] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=71] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682661] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682675] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682703] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682716] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682735] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682774] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:42.682810] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682836] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682859] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682873] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682893] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682913] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682943] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682963] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682977] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.682992] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683004] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683074] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683129] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683184] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683202] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683220] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683238] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683257] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683304] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683365] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683398] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683412] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683426] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683439] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683532] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683551] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683605] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683639] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683658] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683749] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683763] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683802] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683871] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683904] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683918] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683960] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.683978] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.684003] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.684022] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.684040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.684058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:42.684078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:42.684097] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:42.684117] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:42.684133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:42.684150] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:42.684166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:42.684182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:42.684198] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:42.684213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:42.684234] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:42.684254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:42.684275] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:08:42.684296] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:08:42.687047] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:42.688615] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=39] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585092845568, fast_delete_log_mode=false) [2025-04-21 14:08:42.689587] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2025-04-21 14:08:42.689634] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=36] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:42.689679] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:42.692706] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=36][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:42.692843] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=44][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:42.693705] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFBB-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.695227] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=73] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.695752] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.695816] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.696019] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=56] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.696066] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.696399] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.697644] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=16] Garbage Collector is running(seq_=12, gc_interval=10000000) [2025-04-21 14:08:42.697726] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:42.697759] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=22] gc_check_member_list_ cost time(ret=0, time_us=74) [2025-04-21 14:08:42.697786] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:42.698771] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=64] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.698838] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.698876] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.698923] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.698956] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:42.699566] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:42.699618] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=41] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:42.699658] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=36] execute_gc cost time(ret=0, time_us=45) [2025-04-21 14:08:42.699685] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=22] ObSafeDestroyHandler start process [2025-04-21 14:08:42.699706] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:08:42.699736] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:08:42.708378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:42.719029] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC1-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.719303] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFD9F-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.719681] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC2-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.720759] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC3-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.722594] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC4-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.723034] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC5-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.727910] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC7-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.728347] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC8-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.731587] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE1-0-0] [lt=59] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:42.731729] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFC9-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.744063] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=33] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200077}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094547859000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.744240] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=64][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.744276] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=29] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200077}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.744353] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=27] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846995}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214094547859000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.744420] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=25][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.744450] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCA-0-0] [lt=26] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:1152921504606846995}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.747196] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:42.747227] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:42.747250] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.747729] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCC-0-0] [lt=15][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.751749] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCD-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.752319] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFCE-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.754734] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD0-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.755293] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD1-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.755973] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD2-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.765803] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B0-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.773511] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=60] new mysql sessid created(conn.sessid_=3221487787, support_ssl=false) [2025-04-21 14:08:42.773602] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=41] sm conn init succ(conn.sessid_=3221487787, sess.client_addr_="11.29.122.182:54484") [2025-04-21 14:08:42.773635] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=27] accept one succ(*s={this:0x7f3bc7c04030, session_id:3221487787, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:190}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:42.773923] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=29] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:42.775307] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB0-0-0] [lt=35] MySQL LOGIN(direct_client_ip="11.29.122.182", client_ip=11.29.122.182, tenant_name=sys, tenant_id=1, user_name=root, host_name=%, sessid=3221487787, proxy_sessid=0, client_sessid=3221487787, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=true, capability=683647754, proxy_capability=1480, use_ssl=false, c/s protocol="OB_2_0_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:42.775980] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B2-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.776093] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B2-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.779276] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B8-0-0] [lt=15][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.780735] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15829, max_lsn:26021324, max_scn:{val:1745215722661530000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26021324}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26020735}, last_submit_end_lsn:{lsn:26021324}, last_submit_log_id:15829, last_submit_log_pid:3, max_flushed_lsn:{lsn:26020735}, max_flushed_end_lsn:{lsn:26021324}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26021324}, last_slide_log_id:15829, last_slide_scn:{val:1745215722661530000, v:0}, last_slide_lsn:{lsn:26020735}, last_slide_end_lsn:{lsn:26021324}, last_slide_log_pid:3, last_slide_log_accum_checksum:228977584, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15830, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26021324}, readable_log_tail:{lsn:26021324}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41083444, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:08:42.780991] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=247] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215722664315, last_flushed_end_lsn:{lsn:26021324}}]) [2025-04-21 14:08:42.781037] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=42] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15830, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215722664315, last_flushed_end_lsn:{lsn:26021324}}]) [2025-04-21 14:08:42.785668] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B9-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12291, locations=[{table_id:12291, partition_id:12291, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215722785637, sql_renew_time:1745215722785637, is_mark_fail:false}]) [2025-04-21 14:08:42.787950] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:42.793228] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00B9-0-0] [lt=84][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0xe5af417 0x77c4cd0 0x77b7d5a 0x77b7c6f 0x77a83e6 0x7c9e7cb 0xf560c33 0xf56353d 0x7c63c8b 0x7c638af 0x114e77de 0x114d9fbb 0x114db47e 0x114de0b8 0x114d9fbb 0x12eedcbd 0x12eb8882 0x77695ad 0x75062de 0x7501bbd 0x7500369 0x74b8732 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.795279] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDE3-0-0] [lt=39] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:42.795418] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDE5-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:42.797136] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=71] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:42.813901] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:42.815357] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43609407488, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:42.819785] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:42.824672] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:42.824828] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=147] temporary file module use no blocks [2025-04-21 14:08:42.824848] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:42.824878] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:42.824906] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254927374862, flush_io_finished_ret_:0, flush_io_finished_round_:114, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:42.829978] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:42.839411] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] skip repeat study(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215662850503, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215722839406, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:42.841487] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=103] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662834371000, snapshot_type=1, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:42.841535] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=45] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662469863000, snapshot_type=2, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:42.841552] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=15] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662670149000, snapshot_type=3, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:42.841566] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=12] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:42.841843] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215662850503, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215662469863000, v:0}, reserved_snapshot={val:1745215662469863000, v:0}) [2025-04-21 14:08:42.841885] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] multi-version garbage collector refresh successfully(this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215662850503, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215662469863000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215662835117, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:08:42.841915] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=27] repeat refresh successfully(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215722841913, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215722839517, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:08:42.841939] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] skip repeat reclaim(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215722841913, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215722841938, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:42.847201] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.847184] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=25, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:42.857915] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=30][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:200006}, ls_id={id:-1}) [2025-04-21 14:08:42.858033] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=114][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:08:42.860436] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE35-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:42.860502] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE35-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:42.860565] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=30] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:200006}}, ls_id:{id:1001}, renew_time:1745215722860455, transfer_seq:0}) [2025-04-21 14:08:42.862907] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=67] LOCATION: block refresh table cache succ(tablet_id={id:200006}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215722862893, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:08:42.864895] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=71] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200006}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214091734217000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:08:42.869406] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:42.869468] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.873194] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=68] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846982}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214091734217000, delete_commit_version:-1}, snapshot_version=1745215722745024000) [2025-04-21 14:08:42.873388] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=50][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:08:42.873433] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD4-0-0] [lt=37] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:1152921504606846982}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:08:42.880443] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD5-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.880823] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=367) [2025-04-21 14:08:42.881355] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD6-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.883884] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00BC-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.886650] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00BF-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.890779] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1001][YB420B1D7AB6-00063343B4AF00C0-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0xe5af417 0x77c4cd0 0x77b7d5a 0x77b7c6f 0x77a83e6 0x7c9e7cb 0xf560c33 0xf56353d 0x7c63c8b 0x7c638af 0x114e77de 0x114d9fbb 0x114db47e 0x114de0b8 0x114d9fbb 0x12eedcbd 0x12eb8882 0x77695ad 0x75062de 0x7501bbd 0x7500369 0x74b8732 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.899163] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD8-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.902781] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFD9-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.908219] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDCE-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:42.908422] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFDC-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.908617] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:42.911675] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFDF-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.914346] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFE1-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:42.914447] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=50] start to print blacklist info [2025-04-21 14:08:42.914647] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=46] ls blacklist refresh finish(cost_time=9857) [2025-04-21 14:08:42.922111] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDE7-0-0] [lt=22] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:42.947286] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:42.948869] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:42.948930] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:42.956378] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=36] current monitor number(seq_=-1) [2025-04-21 14:08:43.010663] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:43.010716] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB7-0-0] [lt=28] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:43.010730] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=65] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:43.010757] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB7-0-0] [lt=37] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:43.015899] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:43.034070] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:43.047354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.051169] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=16] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:43.051274] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=60] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:43.051307] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=180, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:43.051380] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=647716864, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=426024960, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:43.051465] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=42] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:43.051489] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=21, drift_size_=0, pre_drift_size=-8217264, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:43.069772] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:43.069841] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.081889] WDIAG begin (ob_hashtable.h:954) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8F-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.084325] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD8F-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254928634599, cache_obj->added_lc()=false, cache_obj->get_object_id()=667, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:43.106355] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3770) [2025-04-21 14:08:43.108736] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:43.147432] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.216396] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:43.227063] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEC-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:43.227127] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEC-0-0] [lt=61] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:43.232081] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:43.243830] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBC-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:43.243900] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBC-0-0] [lt=60] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=73) [2025-04-21 14:08:43.247509] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.264791] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2086, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:43.264835] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8383) [2025-04-21 14:08:43.264873] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:43.264941] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:43.264965] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2229, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:43.280624] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE39-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:43.280701] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE39-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:43.282287] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFE0-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=26, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:43.282369] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFE0-0-0] [lt=80] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1925, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:43.282386] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFE0-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:43.282400] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFE0-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=-547, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:43.282420] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFE0-0-0] [lt=18] [APPLY STAT CB TOTAL TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1404, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:43.288408] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:43.288501] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:43.288630] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS GROUP SYS](tenant_id=1, io_status=sys_group_name:SSTABLE_WHOLE_SCANNER_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:355, bw:1455067, [delay/us]:prepare:3, schedule:37, submit:11, rt:526, total:578) [2025-04-21 14:08:43.288725] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS TENANT](tenant_id=1, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:2147483648, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:3, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:3}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=88, ops=0, iops=88, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:43.288836] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS FUNCTION](tenant_id=1, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:356, avg_bw:1454980, [delay/us]: prepare:3, schedule:37, submit:11, device:526, total:578) [2025-04-21 14:08:43.288922] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:43.289166] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:43.289281] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:12, schedule:38, submit:6, rt:1163, total:1220) [2025-04-21 14:08:43.289348] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:ROOT_BLOCK_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:6, bw:24519, [delay/us]:prepare:9, schedule:44, submit:23, rt:703, total:781) [2025-04-21 14:08:43.289404] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=1, ops=0, iops=1, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:43.289469] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:6, avg_bw:24517, [delay/us]: prepare:9, schedule:44, submit:23, device:703, total:781) [2025-04-21 14:08:43.289498] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:12, schedule:38, submit:6, device:1163, total:1220) [2025-04-21 14:08:43.289576] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:43.289675] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:586, total:600) [2025-04-21 14:08:43.289775] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:43.289839] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4085, [delay/us]: prepare:0, schedule:0, submit:600000000, device:586, total:600) [2025-04-21 14:08:43.289919] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:43.289959] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:43.306548] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:43.308411] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:08:43.308659] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:43.308880] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:43.329651] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:43.330875] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:43.330975] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215721174527000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:43.347577] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.369558] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:43.369614] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.380700] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:43.380783] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1762, avg_group_log_size=176) [2025-04-21 14:08:43.380815] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1762) [2025-04-21 14:08:43.380838] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:43.380871] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:43.380894] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=6291, avg_group_log_size=524) [2025-04-21 14:08:43.380917] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=6291) [2025-04-21 14:08:43.380933] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:43.382354] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1615, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:43.382401] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1762) [2025-04-21 14:08:43.382436] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:43.382417] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1450, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:43.382462] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=6291) [2025-04-21 14:08:43.382498] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:43.382486] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1762) [2025-04-21 14:08:43.382551] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:43.382578] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1849, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:43.382599] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1798, avg_log_submit_to_slide_time=1816) [2025-04-21 14:08:43.382634] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:43.382665] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=6291) [2025-04-21 14:08:43.382648] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1762, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:43.382711] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:43.382731] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1645, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:43.382749] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1616, avg_log_submit_to_slide_time=1633) [2025-04-21 14:08:43.382777] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:43.382792] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=6291, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:43.414254] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=179] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:43.415696] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8383) [2025-04-21 14:08:43.415763] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=2176, avg_log_submit_to_slide_time=2198) [2025-04-21 14:08:43.415792] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:43.415832] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8383, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:43.416901] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:43.419714] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:43.426217] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=12200000, clean_num=200000) [2025-04-21 14:08:43.427287] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=78] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8383, avg_group_log_size=493) [2025-04-21 14:08:43.427331] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:08:43.428626] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=55] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:43.428685] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:43.428710] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:43.428748] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:43.428774] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254927978855, flush_io_finished_ret_:0, flush_io_finished_round_:115, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:43.428945] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:43.430051] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:43.447660] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.449084] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:43.449141] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.456178] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4015, offset=60903}, end_cursor:ObLogCursor{file_id=3, log_id=4016, offset=61209}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77488050, len:537, log_data_len:306, seq:4015, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:43.456542] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:43.456610] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=47] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215723187060000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215723187060000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:43.459782] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=13] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=1, MAX_GAP=900000000000, new_sync_scn={val:1745215722185961001, v:0}, new_replayable_scn={val:1745215722185961001, v:0}, new_readable_scn={val:1745215722185961000, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215721185308000, replayable_scn:1745215721185308000, readable_scn:1745215721174527001, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:08:43.460090] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1745215723459943000, start_id=1745215723459943000, end_id=1745215723459943001) [2025-04-21 14:08:43.463478] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4016, offset=61209}, end_cursor:ObLogCursor{file_id=3, log_id=4017, offset=61506}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7748c050, len:4327, log_data_len:297, seq:4016, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:43.463768] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:43.463831] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE50-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215723187060000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215723187060000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:43.464129] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215722912665002, v:0}, new_max_version={val:1745215722912665002, v:0}, last_min_version={val:1745215722912665000, v:0}, last_max_version={val:1745215722912665000, v:0}, total_time_us=2917, delta_us=551461) [2025-04-21 14:08:43.464165] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=35] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215722912665002, v:0}, min_version={val:1745215722912665002, v:0}, max_version={val:1745215722912665002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:43.475128] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.475200] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.475383] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=72] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.475655] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.506646] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=86] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:43.506747] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=81] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:43.508025] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1847, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:43.508078] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:43.508116] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:43.508182] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:43.508209] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2026, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:43.508229] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1961, avg_log_submit_to_slide_time=1993) [2025-04-21 14:08:43.508266] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=72, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:43.509041] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:43.547730] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.553029] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFE2-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.553028] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDA0-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.553042] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD92-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.555612] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDA2-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.555731] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD93-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.556991] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFE5-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.560605] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:43.562006] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=49] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:43.562124] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215715562497000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:43.562140] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDBF-0-0] [lt=35] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:43.562175] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=47] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215715562497000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1745215715562497000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:43.563900] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=22] ====== traversal_flush timer task ====== [2025-04-21 14:08:43.564005] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9C-0-0] [lt=37] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215723187060002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:43.564162] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9C-0-0] [lt=119] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:43.564233] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9C-0-0] [lt=68] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:43.569949] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:43.570000] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.576257] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:08:43.579819] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:43.579875] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:43.579910] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=31] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:43.579950] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:43.579984] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=31] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254928130046, flush_io_finished_ret_:0, flush_io_finished_round_:115, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:43.591259] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215723591253, bytes: 4541054, bw: 0.013564 MB/s, add_ts: 1000006, add_bytes: 14223 [2025-04-21 14:08:43.592019] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:43.603306] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:43.603346] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:43.605192] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:43.605228] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:43.626774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:43.627153] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215723626427000, start_id=1745215723626427000, end_id=1745215723626427001) [2025-04-21 14:08:43.640454] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:08:43.641502] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=38] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:43.641561] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=58] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:43.641628] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=32] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:43.641727] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=94] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:43.641754] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:43.641775] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=0, rec_log_ts={val:1745215714176938001, v:0}) [2025-04-21 14:08:43.641793] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:43.641817] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:43.641848] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:43.641870] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:43.641899] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:43.641936] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:43.642928] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:43.642966] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=37] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:43.643020] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:43.643085] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=63] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:43.643105] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:43.643126] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:43.643148] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:43.643168] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:43.643190] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:43.643214] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:43.643232] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:43.647796] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.654883] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFE7-0-0] [lt=64][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.655487] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFE8-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.658122] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1745215723658117, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007606, add_bytes: 0 [2025-04-21 14:08:43.661926] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFEA-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.662483] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFEB-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.663900] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFEC-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.668634] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFED-0-0] [lt=51] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=6.903252077102661133e+01, this=0x7f3c39c57208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=345, Throttle Trigger(MB)=207, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.232212192105849681e+03) [2025-04-21 14:08:43.671771] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFEF-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.672019] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=38] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:43.672638] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF0-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.673128] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF1-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.675898] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF3-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.676371] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF4-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.682194] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:43.682240] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=44] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1781, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:43.682256] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:43.682269] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=-549, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:43.682281] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=11] [APPLY STAT CB TOTAL TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1294, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:43.688012] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1745215723687543000, start_id=1745215723687543000, end_id=1745215723687543001) [2025-04-21 14:08:43.688109] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=67] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:43.688408] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=35] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215723688383], gts:1745215723687543000, latest_srr:[mts=1745215723688383]}) [2025-04-21 14:08:43.695652] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695679] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695761] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695819] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695861] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695926] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.695964] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.696005] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.696044] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.696111] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.696155] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:43.709200] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:43.726210] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF7-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.726947] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF8-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.735823] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFF9-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.737855] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFFB-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:43.747870] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.762548] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9E-0-0] [lt=44] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:43.780888] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:43.780936] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] try gc retain ctx [2025-04-21 14:08:43.780951] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:43.781019] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215723669191000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215713676177000, v:0}, keep_alive_scn_:{val:1745215718682379000, v:0}, update_ts_:1745215723780900}) [2025-04-21 14:08:43.781959] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215730473222000, latest_log_ts:{val:1745215714176938001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:43.782153] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=101] finish update min start scn(max_decided_scn={val:1745215723669191000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215713676177000, v:0}, keep_alive_scn_:{val:1745215718682379000, v:0}, update_ts_:1745215723781963}) [2025-04-21 14:08:43.783448] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:43.788067] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:43.812368] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:43.812417] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:43.814268] INFO [SQL] check_session_leak (ob_sql_session_mgr.cpp:656) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=19] get current session count(used_session_count=23, hold_session_count=23, session_leak_count_threshold=100) [2025-04-21 14:08:43.814533] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:43.819858] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:08:43.825038] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:43.825087] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] temporary file module use no blocks [2025-04-21 14:08:43.825104] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:43.825125] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:43.825143] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254928375270, flush_io_finished_ret_:0, flush_io_finished_round_:115, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:43.827339] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:43.830174] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=65] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:43.837397] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:08:43.847939] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.861953] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE36-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:43.862017] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE36-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:43.869742] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:43.869828] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.896762] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:43.898473] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1745215723898001000, start_id=1745215723898001000, end_id=1745215723898001001) [2025-04-21 14:08:43.909345] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:43.912016] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:43.948009] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:43.949262] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:43.949327] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:43.956488] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=44] current monitor number(seq_=-1) [2025-04-21 14:08:43.961546] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215723669191000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=292345, in_cluster_service=true, cluster_version={val:1745215723187060003, v:0}, min_cluster_version={val:1745215723187060003, v:0}, max_cluster_version={val:1745215723187060003, v:0}, get_cluster_version_err=0, cluster_version_delta=774476, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1012, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=54837272, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:44.027896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=91] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:44.034192] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:44.048075] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.059420] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] get_max_applied_scn(scn={val:1745215723961056000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65731859}, palf_committed_end_scn_:{val:1745215723961056000, v:0}, last_check_scn_:{val:1745215723961056000, v:0}, max_applied_cb_scn_:{val:1745215723961056000, v:0}}) [2025-04-21 14:08:44.059468] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65731859}, readable_log_tail:{lsn:65731859}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1372909, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:44.061100] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:44.061147] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:08:44.061168] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:08:44.061190] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:44.064334] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:3, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:08:44.064682] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=345] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:44.070112] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:44.070160] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.087796] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C2-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.090351] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C2-0-0] [lt=32][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254929640658, cache_obj->added_lc()=false, cache_obj->get_object_id()=668, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:44.107077] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:44.109037] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=45][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:44.109469] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:44.148145] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.188686] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=34] ts response task statistics(alloc_count=2526, free_count=1262) [2025-04-21 14:08:44.189056] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=69] submit log success(service_type_=0, last_id=1745215740473222000, limited_id=1745215740473222000) [2025-04-21 14:08:44.189091] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=33] submit log with lock success(service_type_=0, last_id=1745215740473222000, limited_id=1745215740473222000) [2025-04-21 14:08:44.189120] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=15] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=499, get_gts_with_stc_cnt=13, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=12, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:44.190338] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215740473222000, latest_scn={val:1745215724188868002, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215721185308000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:44.190427] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=87] handle submit callback(service_type_=0, success=true, used_ts=1372, log_ts={val:1745215724188868002, v:0}, limited_id=1745215740473222000) [2025-04-21 14:08:44.190455] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=26] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:44.190476] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76EFFEE-0-0] [lt=20] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:44.216005] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=53, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:44.216045] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=39] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=1752, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:44.216060] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:44.216073] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=11] [APPLY STAT CB EXECUTE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=-543, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:44.216096] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] [APPLY STAT CB TOTAL TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=1263, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:44.228494] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=88] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:44.228566] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDED-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:44.228609] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDED-0-0] [lt=42] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:44.229173] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] get_max_applied_scn(scn={val:1745215724062658000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26033565}, palf_committed_end_scn_:{val:1745215724227317000, v:0}, last_check_scn_:{val:1745215724227317000, v:0}, max_applied_cb_scn_:{val:1745215724062658000, v:0}}) [2025-04-21 14:08:44.229228] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26033565}, readable_log_tail:{lsn:26033565}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41071203, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:44.248213] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.264668] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=65] get_max_applied_scn(scn={val:1745215723687543003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17336701}, palf_committed_end_scn_:{val:1745215724188868002, v:0}, last_check_scn_:{val:1745215724188868002, v:0}, max_applied_cb_scn_:{val:1745215723687543003, v:0}}) [2025-04-21 14:08:44.264725] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17336701}, readable_log_tail:{lsn:17336701}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49768067, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:44.282070] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3A-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:44.282125] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3A-0-0] [lt=53] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:44.282933] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=49] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:44.290970] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:44.291028] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:44.291215] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:44.291396] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:44.291491] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12260, [delay/us]:prepare:15, schedule:32, submit:7, rt:1450, total:1505) [2025-04-21 14:08:44.291568] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:44.291624] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12261, [delay/us]: prepare:15, schedule:32, submit:7, device:1450, total:1505) [2025-04-21 14:08:44.291684] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:44.291753] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:621, total:636) [2025-04-21 14:08:44.291827] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:44.291862] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:621, total:636) [2025-04-21 14:08:44.291921] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:44.291946] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:44.307233] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:44.309611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:44.348303] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.361906] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=89] get_max_applied_scn(scn={val:1745215723687543004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8754660}, palf_committed_end_scn_:{val:1745215724188868000, v:0}, last_check_scn_:{val:1745215724188868000, v:0}, max_applied_cb_scn_:{val:1745215723687543004, v:0}}) [2025-04-21 14:08:44.361972] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=59] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8754660}, readable_log_tail:{lsn:8754660}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58350108, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:44.363458] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4120) [2025-04-21 14:08:44.363621] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=107] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4120, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:44.365154] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=73] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:44.369960] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:44.370059] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=88] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.381443] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=108] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:44.381546] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:08:44.381597] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:08:44.381638] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:44.381693] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:44.381738] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=2185, avg_group_log_size=218) [2025-04-21 14:08:44.381773] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2185) [2025-04-21 14:08:44.381809] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:44.383194] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1317, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:44.383239] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:08:44.383268] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:44.383269] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1218, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:44.383306] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1217) [2025-04-21 14:08:44.383323] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2185) [2025-04-21 14:08:44.383351] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:44.383368] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:44.383393] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1455, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:44.383413] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=11, avg_log_gen_to_submit_time=40, avg_log_submit_to_flush_time=1400, avg_log_submit_to_slide_time=1415) [2025-04-21 14:08:44.383453] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:44.383489] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=2185) [2025-04-21 14:08:44.383488] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1217, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:44.383520] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:44.383538] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1337, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:44.383556] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1307, avg_log_submit_to_slide_time=1322) [2025-04-21 14:08:44.383595] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:44.383608] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=2185, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:44.390068] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=45] clear dtl interm result cost(us)(clear_cost=10, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:44.390187] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620159][T1001_ObXAHbWor][T1001][Y0-0000000000000000-0-0] [lt=37] XA scheduler heartbeat task statistics(avg_time=3) [2025-04-21 14:08:44.394998] INFO [STORAGE.COMPACTION] schedule_all_tablets_minor (ob_tenant_tablet_scheduler.cpp:579) [620175][T1001_MergeLoop][T1001][YB420B1D7AB6-00063343B9AEFD86-0-0] [lt=47] start schedule all tablet minor merge(minor_ls_tablet_iter_={ls_idx:-1, ls_ids:[{id:1}], tablet_ids:{tablet_idx:0, tablet_cnt:0, array:[], is_inited:false}, schedule_tablet_cnt:0, max_batch_tablet_cnt:50000}) [2025-04-21 14:08:44.396113] INFO [STORAGE.COMPACTION] schedule_all_tablets_medium (ob_tenant_tablet_scheduler.cpp:1585) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8B-0-0] [lt=43] start schedule all tablet merge(merge_version=1) [2025-04-21 14:08:44.396193] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620177][T1001_Compactio][T1001][YB420B1D7AB6-00063343B7CEFD89-0-0] [lt=42] InfoPoolResizeTask(cost_ts=14) [2025-04-21 14:08:44.399133] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:08:44.399243] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9D-0-0] [lt=38] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215724262706000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:44.399367] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9D-0-0] [lt=118] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:44.399438] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:44.399484] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:44.399509] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=22] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=24) [2025-04-21 14:08:44.402463] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:08:44.402503] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:44.414863] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:44.416385] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1276, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:44.416428] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9053) [2025-04-21 14:08:44.416456] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:44.416486] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8931) [2025-04-21 14:08:44.416537] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:44.416560] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1396, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:44.416579] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=17, avg_log_submit_to_flush_time=1358, avg_log_submit_to_slide_time=1372) [2025-04-21 14:08:44.416609] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:44.416645] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8931, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:44.419790] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:44.428224] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=96] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8931, avg_group_log_size=496) [2025-04-21 14:08:44.428271] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8931) [2025-04-21 14:08:44.428906] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:44.428968] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=52] temporary file module use no blocks [2025-04-21 14:08:44.429000] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:44.429050] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:44.429069] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254928979132, flush_io_finished_ret_:0, flush_io_finished_round_:116, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:44.429104] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=97] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:44.430207] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:44.433546] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:44.434559] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:44.434623] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=63] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:44.434708] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:44.434821] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=109] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:44.434868] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:44.434896] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215721425646001, v:0}) [2025-04-21 14:08:44.434916] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:44.434935] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:44.434957] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:44.434988] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:44.435019] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:44.435050] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:44.435086] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:44.435108] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:44.445424] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:81) [620175][T1001_MergeLoop][T1001][YB420B1D7AB6-00063343B9AEFD86-0-0] [lt=46] MergeLoopTask(cost_ts=50460) [2025-04-21 14:08:44.448375] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.449459] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:44.449513] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.465330] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=106] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215723687543004, v:0}, new_max_version={val:1745215723687543004, v:0}, last_min_version={val:1745215723687543002, v:0}, last_max_version={val:1745215723687543002, v:0}, total_time_us=3386, delta_us=777784) [2025-04-21 14:08:44.465383] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=50] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215723687543004, v:0}, min_version={val:1745215723687543004, v:0}, max_version={val:1745215723687543004, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:44.469275] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4017, offset=61506}, end_cursor:ObLogCursor{file_id=3, log_id=4018, offset=61812}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77490050, len:4030, log_data_len:306, seq:4017, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:44.469713] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE51-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:44.469783] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE51-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215724188868003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215724188868003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:44.474540] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.474747] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.474947] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.475625] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4018, offset=61812}, end_cursor:ObLogCursor{file_id=3, log_id=4019, offset=62109}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77494050, len:3724, log_data_len:297, seq:4018, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:44.475877] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE51-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:44.475939] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE51-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215724188868001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215724188868001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:44.476138] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.477242] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=54][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:44.477347] WDIAG read_multi_row (ob_table_access_helper.h:238) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:44.478937] INFO delete_row (ob_table_access_helper.h:312) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215724477387) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215724477387) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:44.491008] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=54] ====== tenant freeze timer task ====== [2025-04-21 14:08:44.492586] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=41] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:44.507375] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:44.507449] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:44.508705] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1456, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:44.508761] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:44.508841] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:44.508874] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1597, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:44.508896] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1553, avg_log_submit_to_slide_time=1569) [2025-04-21 14:08:44.508938] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:44.509738] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:44.533758] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=82] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:44.548455] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.557102] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFFD-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.557104] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDA3-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.558302] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76EFFFE-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.559770] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0001-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.559782] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD94-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.560227] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0002-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.563098] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4120) [2025-04-21 14:08:44.566970] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:08:44.567017] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=39] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:44.570261] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:44.570310] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.574836] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=95] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:44.576275] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=59] gc stale ls task succ [2025-04-21 14:08:44.580136] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=52] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:44.580187] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:08:44.580204] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:44.580231] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:44.580254] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254929130353, flush_io_finished_ret_:0, flush_io_finished_round_:116, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:44.592196] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:44.596799] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C4-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.598278] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1745215724598274, bytes: 4553826, bw: 0.012095 MB/s, add_ts: 1007021, add_bytes: 12772 [2025-04-21 14:08:44.599362] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C4-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254930149670, cache_obj->added_lc()=false, cache_obj->get_object_id()=669, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:44.599468] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=103] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:44.601216] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C8-0-0] [lt=39][errcode=-4201] hashtable not init [2025-04-21 14:08:44.601258] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C8-0-0] [lt=40] get cursor info failed(cursor_id=37, get_sessid()=3221487630) [2025-04-21 14:08:44.601410] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215724600432000, start_id=1745215724600432000, end_id=1745215724600432001) [2025-04-21 14:08:44.603273] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:44.603314] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:44.604919] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:44.604955] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:44.614976] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:44.615015] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=38] try gc retain ctx [2025-04-21 14:08:44.615029] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:44.615070] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215724477445000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215714522539001, v:0}, keep_alive_scn_:{val:1745215719523153001, v:0}, update_ts_:1745215724614412}) [2025-04-21 14:08:44.616140] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:44.629325] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:44.629659] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:44.642773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=20] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000) [2025-04-21 14:08:44.642839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=65] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.642921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643764] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.643918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.644996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.645930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.646913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.647953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.648552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.648994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=39] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649563] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.649930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.650983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.651966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652673] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=22] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:44.652707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652737] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=47] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=22) [2025-04-21 14:08:44.652777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.652991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=52] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653780] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=28] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:44.653829] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:44.653857] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:44.653864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.653877] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=22) [2025-04-21 14:08:44.653950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.654968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.655932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.656961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.657950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.658956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.659979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.660966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.661947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662014] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.662982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.663946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.664953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665731] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215724665726, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007609, add_bytes: 0 [2025-04-21 14:08:44.665779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.665936] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.666996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.667946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.668997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.669939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670496] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670647] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.670942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.671996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.672983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.673993] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674558] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.674923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.675941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676151] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.676938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.677939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.678983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679121] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.679963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.680961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.681980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.682974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.683982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684738] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:44.684784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.684995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.685973] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:44.685986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686066] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215718754591000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:44.686116] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215718754591000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1745215718754591000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:44.686177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.686976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.687955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688099] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688593] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=24] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:44.688612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688646] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=40] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=24) [2025-04-21 14:08:44.688684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.688959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689050] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689409] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:44.689480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689490] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=61] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=413, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:44.689532] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215724689472], gts:1745215724689422000, latest_srr:[mts=1745215724689472]}) [2025-04-21 14:08:44.689551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.689966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.690952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691016] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:08:44.691058] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=33] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:44.691093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691102] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:44.691164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.691964] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:44.692011] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:44.692029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692037] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=24) [2025-04-21 14:08:44.692105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.692955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.693958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.694882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=49] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695266] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695316] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695526] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=44] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695779] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695804] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695847] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695896] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.695947] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695991] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.695996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696081] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.696138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696197] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:44.696226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=46] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.696945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=46] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.697959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.698947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699866] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.699938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.700991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.701996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.702996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.703971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704685] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.704976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.705967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.706984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707611] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707818] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.707952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.708945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.709991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710927] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.710998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.711982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.712969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213918754591000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213908742072000, max_merged_snapshot=1) [2025-04-21 14:08:44.713423] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD89-0-0] [lt=21] SSTableGCTask(cost_ts=70953) [2025-04-21 14:08:44.716382] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5700000, replace_num=100000) [2025-04-21 14:08:44.716437] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:44.732030] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0006-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.732739] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0007-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.738774] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0008-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.740370] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F000A-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:44.748599] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.761399] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=98] get number(ret=0, service_type_=0, range=1, base_id=1745215724761235000, start_id=1745215724761235000, end_id=1745215724761235001) [2025-04-21 14:08:44.785396] INFO [STORAGE] refresh_queuing_mode (ob_tenant_tablet_stat_mgr.cpp:1160) [619796][T1_TabletStatRp][T1][Y0-0000000000000000-0-0] [lt=28] refresh queuing mode(ret=0, tenant_id=1, stream_cnt=0, update_schema_cnt=0, cost_time=14) [2025-04-21 14:08:44.785441] INFO [STORAGE] runTimerTask (ob_tenant_tablet_stat_mgr.cpp:1210) [619796][T1_TabletStatRp][T1][Y0-0000000000000000-0-0] [lt=41] TenantTabletStatMgr refresh all tablet stream(MTL_ID()=1, interval_step=1, global_iter_pool={is_inited:false, is_washing:false, is_disabled:false, get_cnt:0, tenant_id:1, bucket_cnt:0, tenant_mem_user_limit:5368709120, tenant_mem_user_hold:311758848, cached_node_array:0x7f3c6c1f3b10}) [2025-04-21 14:08:44.788186] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:44.815179] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=98] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:44.819958] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:44.827820] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF92-0-0] [lt=47] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035222244262695312e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739968279972239316e+02) [2025-04-21 14:08:44.830275] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:44.830415] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:44.848670] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.864174] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE37-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:44.864246] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE37-0-0] [lt=69] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:44.870165] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:44.870226] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.892935] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:44.893020] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=60] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:44.893045] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=24] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:44.893063] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:44.896403] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] Dumping All Cache Objs(alloc_obj_list.count()=328, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}]) [2025-04-21 14:08:44.897139] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=732] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:44.915005] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=40] blacklist_loop exec finished(cost_time=24, is_enabled=true, send_cnt=0) [2025-04-21 14:08:44.916568] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:44.923863] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=39] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:44.948745] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:44.949639] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:44.949703] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:44.956672] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=61] current monitor number(seq_=-1) [2025-04-21 14:08:44.971988] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:45.008286] INFO [STORAGE.COMPACTION] add_event_and_diagnose (ob_medium_loop.cpp:203) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8B-0-0] [lt=39] finish schedule all tablet merge(merge_version_=1, schedule_stats_={all_ls_weak_read_ts_ready:true, start_timestamp:0}, loop_cnt=0, tenant_merge_finish=true, is_scan_all_tablet_finish=true, schedule_tablet_cnt={schedule_dag_cnt:0, submit_clog_cnt:0, finish_cnt:956, loop_tablet_cnt:956, force_freeze_cnt:0, wait_rs_validate_cnt:0}, time_guard=GET_TABLET=16.68ms|INIT_TABLET_STATUS=57.54ms|SCHEDULE_NEXT_MEDIUM=4.77ms|SCHEDULE_TABLET_EXECUTE=533.13ms|) [2025-04-21 14:08:45.008361] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:95) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8B-0-0] [lt=70] MediumLoopTask(cost_ts=612281) [2025-04-21 14:08:45.008396] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8C-0-0] [lt=18] MediumCheckTask(cost_ts=9) [2025-04-21 14:08:45.011448] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:45.011489] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=40] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:45.011483] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB8-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:45.011522] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB8-0-0] [lt=34] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:45.030896] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=84] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:45.034328] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:45.048819] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.051115] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=41] LogLoopThread round_cost_time(us)(round_cost_time=22) [2025-04-21 14:08:45.070457] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:45.070521] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.094335] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CA-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.096576] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CA-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254930646883, cache_obj->added_lc()=false, cache_obj->get_object_id()=670, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:45.107802] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3971) [2025-04-21 14:08:45.116710] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:45.148882] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.190063] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215725190030], gts:1745215725189675000, latest_srr:[mts=1745215725190030]}) [2025-04-21 14:08:45.226821] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215725027708000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199104, in_cluster_service=true, cluster_version={val:1745215724827928000, v:0}, min_cluster_version={val:1745215724827928000, v:0}, max_cluster_version={val:1745215724827928000, v:0}, get_cluster_version_err=0, cluster_version_delta=398884, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1024, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=60047405, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:45.230097] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEE-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:45.230144] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEE-0-0] [lt=44] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:45.231434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:45.241208] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:45.244501] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBD-0-0] [lt=50] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:45.244548] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBD-0-0] [lt=40] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2025-04-21 14:08:45.248950] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.266640] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215725266519000, start_id=1745215725266519000, end_id=1745215725266519001) [2025-04-21 14:08:45.283601] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3B-0-0] [lt=15] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:45.283673] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3B-0-0] [lt=69] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:45.292973] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:45.293044] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:45.293223] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:45.293320] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS GROUP SYS](tenant_id=1001, io_status=sys_group_name:SSTABLE_WHOLE_SCANNER_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:954, bw:3907932, [delay/us]:prepare:3, schedule:34, submit:10, rt:462, total:510) [2025-04-21 14:08:45.293387] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1001, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=238, ops=0, iops=238, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:45.293442] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS FUNCTION](tenant_id=1001, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:954, avg_bw:3907616, [delay/us]: prepare:3, schedule:34, submit:10, device:462, total:510) [2025-04-21 14:08:45.293496] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:45.293573] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:12, schedule:20, submit:6, rt:1114, total:1152) [2025-04-21 14:08:45.293641] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:45.293677] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:12, schedule:20, submit:6, device:1114, total:1152) [2025-04-21 14:08:45.293734] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:45.293805] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:575, total:590) [2025-04-21 14:08:45.293878] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:45.293913] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:575, total:590) [2025-04-21 14:08:45.293972] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:45.293996] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:45.316826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:45.348374] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=29] success to update min reserved snapshot(reserved_snapshot=1745213918754591000, duration=1800, snapshot_gc_ts=1745215718754591000) [2025-04-21 14:08:45.349023] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.349222] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] success to update min reserved snapshot(reserved_snapshot=1745213915562497000, duration=1800, snapshot_gc_ts=1745215715562497000) [2025-04-21 14:08:45.349301] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4083, avg_group_log_size=371) [2025-04-21 14:08:45.352136] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=34] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:45.353644] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFD9E-0-0] [lt=58] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:08:45.354262] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1745215725353912000, start_id=1745215725353912000, end_id=1745215725353912001) [2025-04-21 14:08:45.367341] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26042529}], scn_array=[cnt:1, {val:1745215725266519001, v:0}], curr_size=112, accum_size=8365, time_cost=18834) [2025-04-21 14:08:45.367580] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] update reserved snapshot finished(cost_ts=19209, reserved_snapshot=1745213918754591000) [2025-04-21 14:08:45.367893] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65740755, this={dio_aligned_buf:{buf_write_offset:67, buf_padding_size:4029, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3246, truncate_used_ts:1306}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=8192, aligned_block_offset=65736704, buf_len=112, total_write_size=37999, total_write_size_after_dio=475136, ob_pwrite_used_ts=212954, count=106, each_pwrite_cost=2009) [2025-04-21 14:08:45.367951] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=53][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65736659}], scn_array=[cnt:1, {val:1745215725189675001, v:0}], curr_size=112, accum_size=3498, time_cost=18636) [2025-04-21 14:08:45.367981] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3498) [2025-04-21 14:08:45.368093] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3498, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:45.368240] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=29] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213915562497000) [2025-04-21 14:08:45.368277] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] update reserved snapshot finished(cost_ts=19059, reserved_snapshot=1745213915562497000) [2025-04-21 14:08:45.370339] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:45.370415] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.382174] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:45.382226] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:45.382250] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:45.382284] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:45.382315] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:45.383603] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1320, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:45.383653] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:45.383654] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1278, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:45.383693] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:45.383720] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:45.383756] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:45.383799] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:45.383821] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1431, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:45.383834] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1396, avg_log_submit_to_slide_time=1408) [2025-04-21 14:08:45.383864] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:45.383890] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:45.383881] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:45.383918] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:45.383937] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1397, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:45.383953] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=1379, avg_log_submit_to_slide_time=1389) [2025-04-21 14:08:45.383983] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:45.383993] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:45.415572] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:45.416833] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=2268, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:45.416873] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8487) [2025-04-21 14:08:45.416899] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:45.416935] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8487) [2025-04-21 14:08:45.416989] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:45.417030] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=2371, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:45.417051] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=2337, avg_log_submit_to_slide_time=2352) [2025-04-21 14:08:45.417079] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:45.417113] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8487, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:45.419859] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:45.423448] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=34] skip repeat study(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215665437840, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215725423444, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:45.424821] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665417380000, snapshot_type=1, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:45.424865] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665179407000, snapshot_type=2, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:45.424882] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=16] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665378928001, snapshot_type=3, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:45.424905] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=20] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:45.425085] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215665437840, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215665179407000, v:0}, reserved_snapshot={val:1745215665179407000, v:0}) [2025-04-21 14:08:45.425122] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=35] multi-version garbage collector refresh successfully(this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215665437840, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215665179407000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215665418079, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:08:45.425152] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=28] repeat refresh successfully(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215725425150, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215725423498, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:08:45.425174] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=21] skip repeat reclaim(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215725425150, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215725425173, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:45.428430] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8486, avg_group_log_size=471) [2025-04-21 14:08:45.428469] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8487) [2025-04-21 14:08:45.430349] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:45.431992] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:45.442030] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=12400000, clean_num=200000) [2025-04-21 14:08:45.449105] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.449873] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:45.449943] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.469152] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215724689422004, v:0}, new_max_version={val:1745215724689422004, v:0}, last_min_version={val:1745215724689422002, v:0}, last_max_version={val:1745215724689422002, v:0}, total_time_us=4222, delta_us=779726) [2025-04-21 14:08:45.469218] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=64] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215724689422004, v:0}, min_version={val:1745215724689422004, v:0}, max_version={val:1745215724689422004, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:45.475315] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.475841] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.475924] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.475968] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.481723] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4019, offset=62109}, end_cursor:ObLogCursor{file_id=3, log_id=4020, offset=62415}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77498050, len:3427, log_data_len:306, seq:4019, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:45.482115] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE52-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:45.482184] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE52-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215725189675001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215725189675001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:45.482281] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1342) [2025-04-21 14:08:45.482343] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1342, avg_group_log_size=122) [2025-04-21 14:08:45.482376] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1342) [2025-04-21 14:08:45.483409] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:08:45.488380] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=58] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4020, offset=62415}, end_cursor:ObLogCursor{file_id=3, log_id=4021, offset=62712}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7749c050, len:3121, log_data_len:297, seq:4020, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:45.488657] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE52-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:45.488715] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE52-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215725189675001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215725189675001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:45.508045] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:45.508106] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:45.509233] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2814, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:45.509283] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:45.509337] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:45.509365] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4164, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:45.509388] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:45.516951] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:45.528682] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] get wrs ts(ls_id={id:1}, delta=99934, log_service_ts=1745215725428129, min_tx_service_ts=4611686018427387, timestamp={val:1745215725428129000, v:0}) [2025-04-21 14:08:45.528746] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=74, Other_Error_Cnt=0, Submit_Succ_Cnt=26, last_scn="{val:1745215724477445001, v:0}", last_lsn={lsn:26037395}, last_gts={val:1745215725490392000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:08:45.549178] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.561098] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F000C-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.561099] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDA5-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.561259] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD95-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.563758] WDIAG begin (ob_hashtable.h:954) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8A-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.564136] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4571) [2025-04-21 14:08:45.564196] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=1143, avg_log_gen_to_submit_time=1159, avg_log_submit_to_flush_time=2797, avg_log_submit_to_slide_time=2820) [2025-04-21 14:08:45.564370] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F000F-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.565644] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0011-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.567408] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC0-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:45.570671] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:45.570750] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.576361] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:08:45.592349] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:45.595243] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:45.595344] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:08:45.596713] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CC-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.599080] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CC-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254931149387, cache_obj->added_lc()=false, cache_obj->get_object_id()=671, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:45.603110] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:45.603152] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:45.603237] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215725603233, bytes: 4569350, bw: 0.014732 MB/s, add_ts: 1004959, add_bytes: 15524 [2025-04-21 14:08:45.604870] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:45.604907] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:45.642605] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:45.649373] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.649562] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=56] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:45.666295] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1745215725666291, bytes: 0, bw: 0.000000 MB/s, add_ts: 1000565, add_bytes: 0 [2025-04-21 14:08:45.690527] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=47] handle gts request statistics(total_rt=463, total_cnt=60, avg_rt=7.590163934426229275e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:08:45.690592] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=47] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:45.695333] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695390] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695597] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695650] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695848] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695897] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695905] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695957] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.695998] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.696032] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.696282] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:45.707965] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=23] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17338409}, readable_log_tail:{lsn:17338409}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49766359, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:45.708080] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=114] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:08:45.708104] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8756368}, readable_log_tail:{lsn:8756368}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58348400, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:45.708168] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=64] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:08:45.708204] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=13] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:45.717089] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:45.733735] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE3-0-0] [lt=63] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:45.733787] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE4-0-0] [lt=37][errcode=-4006] not init(ret=-4006) [2025-04-21 14:08:45.733810] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:478) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE4-0-0] [lt=15] finish scan map holding items(scan_cnt=0) [2025-04-21 14:08:45.733916] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE5-0-0] [lt=20] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:45.739332] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0015-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.739982] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0016-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.741174] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0017-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.742547] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0019-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:45.743090] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=27] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:08:45.743135] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=41] finish to resize log external storage handler(current_ts=1745215725743131, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:45.743259] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=64] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:45.746825] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=12, gc_interval=10000000) [2025-04-21 14:08:45.746911] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=46] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:45.746940] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=25] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:45.746967] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_check_member_list_ cost time(ret=0, time_us=95) [2025-04-21 14:08:45.746992] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:45.748636] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:45.749503] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:45.749532] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:45.749555] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.749956] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:45.750000] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:45.750026] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:45.750046] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=49) [2025-04-21 14:08:45.750065] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyHandler start process [2025-04-21 14:08:45.760451] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9D-0-0] [lt=24] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:08:45.760505] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9D-0-0] [lt=45] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:08:45.763542] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=40][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:45.788297] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:45.797698] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDE7-0-0] [lt=22] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:45.798765] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17338409}], scn_array=[cnt:1, {val:1745215725690140000, v:0}], curr_size=122, accum_size=366, time_cost=16242) [2025-04-21 14:08:45.798807] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8756368}], scn_array=[cnt:1, {val:1745215725690140000, v:0}], curr_size=122, accum_size=488, time_cost=16237) [2025-04-21 14:08:45.812533] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:08:45.812585] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:45.815445] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=26] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:08:45.815489] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=42] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=7) [2025-04-21 14:08:45.815509] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=19] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:08:45.815531] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=19] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:08:45.815847] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:45.820055] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:45.825346] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:45.825400] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:45.825425] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:45.825451] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:45.825476] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254930375580, flush_io_finished_ret_:0, flush_io_finished_round_:117, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:45.830495] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF97-0-0] [lt=35] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035222244262695312e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739968279972239316e+02) [2025-04-21 14:08:45.830588] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:45.832263] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:45.836888] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10127, max_lsn:17338531, max_scn:{val:1745215725690140000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17338531}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17338409}, last_submit_end_lsn:{lsn:17338531}, last_submit_log_id:10127, last_submit_log_pid:3, max_flushed_lsn:{lsn:17338409}, max_flushed_end_lsn:{lsn:17338531}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17338531}, last_slide_log_id:10127, last_slide_scn:{val:1745215725690140000, v:0}, last_slide_lsn:{lsn:17338409}, last_slide_end_lsn:{lsn:17338531}, last_slide_log_pid:3, last_slide_log_accum_checksum:1549178508, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10128, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17338531}, readable_log_tail:{lsn:17338531}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49766237, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:08:45.837158] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=264] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215725798901, last_flushed_end_lsn:{lsn:17338531}}]) [2025-04-21 14:08:45.837184] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10128, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215725798901, last_flushed_end_lsn:{lsn:17338531}}]) [2025-04-21 14:08:45.837232] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14065, max_lsn:8756490, max_scn:{val:1745215725690140000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8756490}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8756368}, last_submit_end_lsn:{lsn:8756490}, last_submit_log_id:14065, last_submit_log_pid:3, max_flushed_lsn:{lsn:8756368}, max_flushed_end_lsn:{lsn:8756490}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8756490}, last_slide_log_id:14065, last_slide_scn:{val:1745215725690140000, v:0}, last_slide_lsn:{lsn:8756368}, last_slide_end_lsn:{lsn:8756490}, last_slide_log_pid:3, last_slide_log_accum_checksum:1992132490, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14066, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8756490}, readable_log_tail:{lsn:8756490}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58348278, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:08:45.837405] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=172] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215725798957, last_flushed_end_lsn:{lsn:8756490}}]) [2025-04-21 14:08:45.837424] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=17] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14066, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215725798957, last_flushed_end_lsn:{lsn:8756490}}]) [2025-04-21 14:08:45.839013] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=44] ====== tenant freeze timer task ====== [2025-04-21 14:08:45.839092] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=38] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=17) [2025-04-21 14:08:45.839116] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=21] TxData Memory Statistic : (Tenant Total Memory(MB)=5120, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=17, Freeze TxData Trigger Memory(MB)=102, Total TxDataTable Hold Memory(MB)=20, Total TxDataTable Memory Limit(MB)=1024) [2025-04-21 14:08:45.843240] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:45.849518] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.866097] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE38-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:45.866163] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE38-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:45.870524] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:45.870571] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.906267] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD0-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215725906243}) [2025-04-21 14:08:45.906329] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF8-0-0] [lt=28] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215725906303, sql_renew_time:1745215725906303, is_mark_fail:false}]) [2025-04-21 14:08:45.906357] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD0-0-0] [lt=63] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215725906351}) [2025-04-21 14:08:45.906389] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF8-0-0] [lt=59] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215725906243}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215725906303, sql_renew_time:1745215725906303, is_mark_fail:false}]) [2025-04-21 14:08:45.906429] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF9-0-0] [lt=28] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:45.906965] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF9-0-0] [lt=26] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215725906954, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:45.906999] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDF9-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215725906351}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215725906954, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:45.908049] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD0-0-0] [lt=23] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:45.913653] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=39] ls blacklist refresh finish(cost_time=8758) [2025-04-21 14:08:45.917210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:45.919855] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=58] BlockGCTimerTask success(ret=0, cost_time_us=9, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:45.920229] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:45.924238] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDE9-0-0] [lt=47] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:45.936954] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=591) [2025-04-21 14:08:45.949586] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:45.950081] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:45.950140] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:45.956831] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=46] current monitor number(seq_=-1) [2025-04-21 14:08:46.030275] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=63] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:46.034460] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:46.044130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:46.049667] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.051632] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:46.051744] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=59] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:46.051782] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=186, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:46.051895] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=33] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51823345, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=647716864, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=426024960, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:46.052001] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:46.052026] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=25, drift_size_=0, pre_drift_size=-22710224, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:46.071633] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:46.071711] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.100821] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CE-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.103554] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00CE-0-0] [lt=55][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254931653862, cache_obj->added_lc()=false, cache_obj->get_object_id()=672, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:46.108467] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5462) [2025-04-21 14:08:46.108679] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:46.108754] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=69] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:46.108783] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=26] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:46.108808] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:46.109946] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=25] [APPLY STAT CB APPEND COST TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=58, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:46.109991] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=44] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=1932, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:46.110008] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:46.110024] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=-489, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:46.110040] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=14] [APPLY STAT CB TOTAL TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=1501, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:46.112007] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:08:46.112352] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=340] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:46.117346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:46.122370] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:46.123923] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9D-0-0] [lt=39] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=102) [2025-04-21 14:08:46.124134] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215726124070000, start_id=1745215726124070000, end_id=1745215726124070001) [2025-04-21 14:08:46.149738] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.231643] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEF-0-0] [lt=27] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:46.231713] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDEF-0-0] [lt=66] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:46.244708] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=111] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:46.249803] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.285064] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3C-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:46.285126] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3C-0-0] [lt=58] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:46.294966] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:46.295024] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:46.295207] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:46.295391] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:46.295488] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:15, schedule:32, submit:10, rt:1233, total:1291) [2025-04-21 14:08:46.295565] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:46.295624] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:15, schedule:32, submit:10, device:1233, total:1291) [2025-04-21 14:08:46.295687] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:46.295775] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:585, total:599) [2025-04-21 14:08:46.295859] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:46.295898] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:585, total:599) [2025-04-21 14:08:46.295977] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:46.296009] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:46.317472] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:46.336291] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:46.337601] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=47] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:46.337701] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215721174527000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:46.337749] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215721174527000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1745215721174527000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:08:46.349872] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.362753] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=5935, avg_group_log_size=456) [2025-04-21 14:08:46.370712] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:46.370789] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.382879] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:46.382936] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2025-04-21 14:08:46.382961] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:46.382996] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:46.383027] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:46.384453] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3040, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:46.384504] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:46.384539] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=175, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:46.384528] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3039, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:46.384570] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:46.384588] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:08:46.384647] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:46.384667] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3293, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:46.384691] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=3268, avg_log_submit_to_slide_time=3282) [2025-04-21 14:08:46.384728] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:46.384758] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1522) [2025-04-21 14:08:46.384747] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:46.384789] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:46.384810] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3230, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:46.384822] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=3176, avg_log_submit_to_slide_time=3207) [2025-04-21 14:08:46.384841] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:46.384848] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1522, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:46.402626] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=16] ====== check clog disk timer task ====== [2025-04-21 14:08:46.402671] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:46.416231] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:46.417633] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1582, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:46.417675] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8382) [2025-04-21 14:08:46.417708] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:46.417742] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8382) [2025-04-21 14:08:46.417799] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:46.417822] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1706, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:46.417839] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1687) [2025-04-21 14:08:46.417870] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:46.417911] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8382, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:46.419939] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:46.429276] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:46.429330] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:46.429349] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:46.429376] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:46.429404] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254930979512, flush_io_finished_ret_:0, flush_io_finished_round_:118, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:46.430595] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=31] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:46.430899] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8383, avg_group_log_size=493) [2025-04-21 14:08:46.430942] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8382) [2025-04-21 14:08:46.445324] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:46.449949] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.450299] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:46.450358] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.475410] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.475866] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=55] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.475934] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.475944] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.482979] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1522) [2025-04-21 14:08:46.483045] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:46.483079] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:46.484256] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1522) [2025-04-21 14:08:46.492592] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=63] ====== tenant freeze timer task ====== [2025-04-21 14:08:46.492686] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=44] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=17) [2025-04-21 14:08:46.492713] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=23] TxData Memory Statistic : (Tenant Total Memory(MB)=1024, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=17, Freeze TxData Trigger Memory(MB)=20, Total TxDataTable Hold Memory(MB)=20, Total TxDataTable Memory Limit(MB)=204) [2025-04-21 14:08:46.494960] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4021, offset=62712}, end_cursor:ObLogCursor{file_id=3, log_id=4022, offset=63018}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774a0050, len:2824, log_data_len:306, seq:4021, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:46.495327] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE53-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:46.495401] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE53-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215726190349000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215726190349000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:46.501484] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=60] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4022, offset=63018}, end_cursor:ObLogCursor{file_id=3, log_id=4023, offset=63315}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774a4050, len:2518, log_data_len:297, seq:4022, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:46.501775] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE53-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:46.501842] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE53-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215726190349000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215726190349000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:46.508714] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:46.508771] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:46.509969] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1395, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:46.510005] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=6057) [2025-04-21 14:08:46.510035] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:46.510093] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:46.510137] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1515, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:46.510172] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:46.510194] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=6057, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:46.517601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:46.550019] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.551808] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=54] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:46.561302] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215726362398000, v:0}, base_version={val:1745215726162590000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215726362398000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215726561272, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:46.565051] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4862) [2025-04-21 14:08:46.565118] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1470, avg_log_submit_to_slide_time=1490) [2025-04-21 14:08:46.565631] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=61] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215726362398000, v:0}, new_max_version={val:1745215726362398000, v:0}, last_min_version={val:1745215726162590000, v:0}, last_max_version={val:1745215726162590000, v:0}, total_time_us=4264, delta_us=203231) [2025-04-21 14:08:46.565676] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215726362398000, v:0}, min_version={val:1745215726362398000, v:0}, max_version={val:1745215726362398000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:46.565887] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F001C-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.566340] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDA6-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.567138] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:08:46.567176] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:46.567663] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F001D-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.567956] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=13] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:46.568931] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F001F-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.569206] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:46.569306] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215725571082000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:46.569476] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0020-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.570454] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0021-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.571833] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=52] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:46.571890] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.576430] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:46.580479] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=38] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:46.580533] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:46.580551] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:46.580580] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:46.580604] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254931130702, flush_io_finished_ret_:0, flush_io_finished_round_:118, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:46.585493] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=127] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:46.592510] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:46.603705] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:46.603750] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:46.605311] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215726605308, bytes: 4583179, bw: 0.013161 MB/s, add_ts: 1002075, add_bytes: 13829 [2025-04-21 14:08:46.605516] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:46.605555] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:46.645906] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:46.650081] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.672768] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1745215726672763, bytes: 0, bw: 0.000000 MB/s, add_ts: 1006472, add_bytes: 0 [2025-04-21 14:08:46.673544] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0023-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.675288] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1745215716672472, end_time=1745215726675285, dag_status={}) [2025-04-21 14:08:46.675332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=39] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675353] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675371] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675389] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675406] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675441] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:46.675492] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675549] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675592] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675609] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675627] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675663] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675697] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675733] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675802] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675820] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675855] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675873] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675963] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675980] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.675998] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676032] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676050] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676067] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676086] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676138] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676174] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676192] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676267] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676300] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676320] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676338] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676355] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676372] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676404] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676430] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676443] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676461] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676478] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676512] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676564] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676581] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676686] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676722] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:46.676741] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:46.676759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:46.676778] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:46.676794] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:46.676811] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:46.676822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:46.676841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:46.676856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:46.676871] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:46.676882] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:46.676898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=1, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:46.676917] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:08:46.676946] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:08:46.676924] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215726676639000, start_id=1745215726676639000, end_id=1745215726676639001) [2025-04-21 14:08:46.679007] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0027-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.691460] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:46.691683] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=42] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215726691668], gts:1745215726690624000, latest_srr:[mts=1745215726691668]}) [2025-04-21 14:08:46.692360] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:08:46.692404] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=35] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:46.692441] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:46.694782] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.694970] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.695032] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.695339] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.695404] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.695450] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.695758] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.696005] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.696051] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.696086] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.696372] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:46.707359] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=56][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:46.717731] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:46.743774] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F002B-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.744309] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F002C-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.744887] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F002D-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.746048] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F002E-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:46.750155] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.788409] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:46.809033] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=28] ====== traversal_flush timer task ====== [2025-04-21 14:08:46.809172] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9E-0-0] [lt=67] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:46.809323] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9E-0-0] [lt=133] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:46.816591] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:46.820099] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:08:46.825597] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:46.825655] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:46.825681] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:46.825708] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:46.825734] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254931375835, flush_io_finished_ret_:0, flush_io_finished_round_:118, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:46.830747] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:46.831145] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFF9C-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035222244262695312e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739968279972239316e+02) [2025-04-21 14:08:46.839839] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] ====== checkpoint timer task ====== [2025-04-21 14:08:46.840789] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:46.840849] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=58] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:46.840931] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=48] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:46.841048] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=111] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:46.841096] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:46.841123] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215718652117002, v:0}) [2025-04-21 14:08:46.841144] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:46.841163] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:46.841189] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:46.841222] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:46.841246] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:46.841279] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:46.841314] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:46.841335] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:46.846434] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:46.850224] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.868843] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE39-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:46.868914] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE39-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:46.870894] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:46.870947] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.922811] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5800000, replace_num=100000) [2025-04-21 14:08:46.922858] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:46.927401] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=60] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:46.929660] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=34] runTimer to refresh locality_info(ret=0) [2025-04-21 14:08:46.932001] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=32] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:08:46.932065] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=53] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:08:46.932090] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=24] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:08:46.932118] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=21] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:08:46.932135] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:08:46.932158] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:08:46.932174] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:08:46.932193] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:08:46.943323] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD90-0-0] [lt=30] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215722006058, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:46.943398] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD90-0-0] [lt=72] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215722008179, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:46.943436] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD90-0-0] [lt=36] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215722862893, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215722009492, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:46.950294] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:46.950513] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:46.950583] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:46.956978] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:08:47.012217] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:47.012255] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=38] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:47.012262] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD89-0-0] [lt=46] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:47.012302] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD89-0-0] [lt=37] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:47.032520] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:47.034602] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:47.046983] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:47.050355] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.072017] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:47.072069] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.107615] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D0-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.109055] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:47.109097] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] try gc retain ctx [2025-04-21 14:08:47.109113] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] try to retry start_working [2025-04-21 14:08:47.109158] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215726963172000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215717050405001, v:0}, keep_alive_scn_:{val:1745215722055322001, v:0}, update_ts_:1745215727108222}) [2025-04-21 14:08:47.109883] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D0-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254932660190, cache_obj->added_lc()=false, cache_obj->get_object_id()=673, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:47.110143] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215735197259000, latest_log_ts:{val:1745215718652117002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:47.110274] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=100] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:47.122966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:47.129899] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215727030366000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215727129858}, version_delta=99531) [2025-04-21 14:08:47.150434] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.161754] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215726963172000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198573, in_cluster_service=true, cluster_version={val:1745215726762042000, v:0}, min_cluster_version={val:1745215726762042000, v:0}, max_cluster_version={val:1745215726762042000, v:0}, get_cluster_version_err=0, cluster_version_delta=399703, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1072, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=64691882, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:47.191923] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=31] ts response task statistics(alloc_count=2598, free_count=1298) [2025-04-21 14:08:47.191974] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=351, get_gts_with_stc_cnt=30, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:47.234704] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF0-0-0] [lt=28] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:47.234767] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF0-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:47.245038] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBE-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:47.245087] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBE-0-0] [lt=41] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2025-04-21 14:08:47.247552] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:47.249379] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:47.250508] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.286977] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3D-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:47.287053] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3D-0-0] [lt=72] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:47.296969] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:47.297047] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:47.297232] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:47.297418] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:47.297500] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:16, schedule:32, submit:9, rt:1407, total:1466) [2025-04-21 14:08:47.297582] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:47.297644] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:16, schedule:32, submit:9, device:1407, total:1466) [2025-04-21 14:08:47.297706] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:47.297776] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:635, total:650) [2025-04-21 14:08:47.297854] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:47.297890] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:635, total:650) [2025-04-21 14:08:47.297948] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:47.297973] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:47.323102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:47.350583] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.363710] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3526, avg_group_log_size=352) [2025-04-21 14:08:47.371074] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:47.371170] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=87] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.383650] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:47.383707] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:47.383741] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:47.383776] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:47.383806] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:47.384861] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1285, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:47.384902] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1720) [2025-04-21 14:08:47.384938] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:47.384946] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1273, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:47.384987] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1720) [2025-04-21 14:08:47.385018] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:47.385049] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:47.385072] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1383, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:47.385090] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1357, avg_log_submit_to_slide_time=1373) [2025-04-21 14:08:47.385123] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:47.385151] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:08:47.385140] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1720, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:47.385177] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:47.385194] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1386, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:47.385211] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1353, avg_log_submit_to_slide_time=1365) [2025-04-21 14:08:47.385234] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:47.385240] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:47.417074] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:47.418624] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1311, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:47.418668] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8383) [2025-04-21 14:08:47.418726] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:47.418769] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8383) [2025-04-21 14:08:47.418843] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:47.418866] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1429, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:47.418886] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1390, avg_log_submit_to_slide_time=1408) [2025-04-21 14:08:47.418923] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:47.418976] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8383, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:47.420018] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:47.430788] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:47.432345] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8383, avg_group_log_size=493) [2025-04-21 14:08:47.432390] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:08:47.448119] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:47.450667] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.450722] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:47.450772] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.457402] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=83] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=0, clean_num=200000) [2025-04-21 14:08:47.475482] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.475512] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.475549] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.475654] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.483766] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:47.483834] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1720, avg_group_log_size=191) [2025-04-21 14:08:47.483868] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1720) [2025-04-21 14:08:47.485119] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:47.507740] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4023, offset=63315}, end_cursor:ObLogCursor{file_id=3, log_id=4024, offset=63621}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774a8050, len:2221, log_data_len:306, seq:4023, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:47.508178] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE54-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:47.508311] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE54-0-0] [lt=91] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215727191387001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215727191387001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:47.509442] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:47.509536] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:47.510989] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1411, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:47.511047] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:08:47.511104] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:47.511168] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:47.511213] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1560, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:47.511246] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:47.511967] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:47.512102] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE54-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215727511170000, start_id=1745215727511170000, end_id=1745215727511170001) [2025-04-21 14:08:47.515164] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=65] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4024, offset=63621}, end_cursor:ObLogCursor{file_id=3, log_id=4025, offset=63918}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774ac050, len:1915, log_data_len:297, seq:4024, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:47.515468] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE54-0-0] [lt=44] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:47.515551] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE54-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215727191387001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215727191387001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:47.523241] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:47.550783] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.570417] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0030-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.570733] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDAA-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.572084] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0031-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.572197] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:47.572248] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.573253] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0033-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.573288] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD96-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.574491] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0035-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.575683] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC1-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:47.576526] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:47.580733] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:47.580817] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=72] temporary file module use no blocks [2025-04-21 14:08:47.580851] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=29] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:47.580902] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:47.580939] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254932130963, flush_io_finished_ret_:0, flush_io_finished_round_:119, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:47.592714] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:47.600762] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=31] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:47.600841] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=58] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=24) [2025-04-21 14:08:47.603738] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:47.603791] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:47.604840] INFO [STORAGE] refresh_queuing_mode (ob_tenant_tablet_stat_mgr.cpp:1160) [620090][T1001_TabletSta][T1001][Y0-0000000000000000-0-0] [lt=32] refresh queuing mode(ret=0, tenant_id=1001, stream_cnt=0, update_schema_cnt=0, cost_time=14) [2025-04-21 14:08:47.604888] INFO [STORAGE] runTimerTask (ob_tenant_tablet_stat_mgr.cpp:1210) [620090][T1001_TabletSta][T1001][Y0-0000000000000000-0-0] [lt=46] TenantTabletStatMgr refresh all tablet stream(MTL_ID()=1001, interval_step=1, global_iter_pool={is_inited:false, is_washing:false, is_disabled:false, get_cnt:0, tenant_id:1001, bucket_cnt:0, tenant_mem_user_limit:0, tenant_mem_user_hold:0, cached_node_array:0x7f3c4cfd30f0}) [2025-04-21 14:08:47.605819] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:47.605855] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:47.612949] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215727612944, bytes: 4597402, bw: 0.013461 MB/s, add_ts: 1007636, add_bytes: 14223 [2025-04-21 14:08:47.632893] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215727632465000, start_id=1745215727632465000, end_id=1745215727632465001) [2025-04-21 14:08:47.635128] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=68] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215727431792000, v:0}, new_max_version={val:1745215727431792000, v:0}, last_min_version={val:1745215727230856000, v:0}, last_max_version={val:1745215727230856000, v:0}, total_time_us=4833, delta_us=203332) [2025-04-21 14:08:47.635190] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215727431792000, v:0}, min_version={val:1745215727431792000, v:0}, max_version={val:1745215727431792000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:47.650829] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=103][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.658102] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:47.680384] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215727680378, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2025-04-21 14:08:47.684510] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=64] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:47.688908] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=46] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585092841472, fast_delete_log_mode=false) [2025-04-21 14:08:47.691880] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:47.692393] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215727691730000, start_id=1745215727691730000, end_id=1745215727691730001) [2025-04-21 14:08:47.692469] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:47.692519] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=34] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215727692503], gts:1745215727691730000, latest_srr:[mts=1745215727692503]}) [2025-04-21 14:08:47.693287] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:47.693402] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215718754591000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:47.694873] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.694930] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.695435] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.695770] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696058] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696109] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696150] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696190] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696180] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696234] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.696463] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:47.711456] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3648) [2025-04-21 14:08:47.711554] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=70] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1527, avg_log_submit_to_slide_time=1549) [2025-04-21 14:08:47.723387] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:47.747407] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDAC-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.749460] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0038-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.750633] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0039-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.750918] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.751222] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F003A-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:47.788523] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:47.800765] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:47.812733] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=31] ====== check clog disk timer task ====== [2025-04-21 14:08:47.812809] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=64] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:47.817420] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=72] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:47.820245] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:47.825869] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=52] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:47.825925] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:47.825949] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:47.825981] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=30] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:47.826006] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254932376104, flush_io_finished_ret_:0, flush_io_finished_round_:119, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:47.830933] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=47] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:47.832068] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFA1-0-0] [lt=32] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035222244262695312e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739968279972239316e+02) [2025-04-21 14:08:47.840616] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2025-04-21 14:08:47.850994] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:47.858624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:47.870428] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3A-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:47.870503] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3A-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:47.871268] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:47.871320] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.884817] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=45] LogLoopThread round_cost_time(us)(round_cost_time=23) [2025-04-21 14:08:47.923539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:47.923998] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=40] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:47.932170] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:47.950908] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:47.950980] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:47.951082] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.027713] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFDF4-0-0] [lt=95] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:08:48.034728] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=39] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:48.051161] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.059239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=72] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:48.072378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:48.072443] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.109926] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3525) [2025-04-21 14:08:48.114343] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D2-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.116871] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D2-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254933667178, cache_obj->added_lc()=false, cache_obj->get_object_id()=674, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:48.123711] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=92] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:48.151231] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=96][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.193023] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=39] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215728192974], gts:1745215728192213000, latest_srr:[mts=1745215728192974]}) [2025-04-21 14:08:48.234195] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:48.236634] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF1-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:48.236696] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF1-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:48.251297] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.259763] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=93] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:48.268488] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFFAD-0-0] [lt=23] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215728267500, can_tenant_elr:true}) [2025-04-21 14:08:48.270643] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26071175, this={dio_aligned_buf:{buf_write_offset:724, buf_padding_size:3372, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:5540, truncate_used_ts:2280}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26071040, buf_len=589, total_write_size=85658, total_write_size_after_dio=765952, ob_pwrite_used_ts=276564, count=166, each_pwrite_cost=1666) [2025-04-21 14:08:48.287666] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=25, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:48.287706] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=38] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=1432, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:48.287827] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=119] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:48.287841] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=-534, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:48.287855] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=922, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:48.289030] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3E-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:48.289108] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3E-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:48.299044] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:48.299130] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:48.299320] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:48.299531] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:48.299632] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:16, schedule:41, submit:12, rt:1406, total:1476) [2025-04-21 14:08:48.299718] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:48.299780] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:16, schedule:41, submit:12, device:1406, total:1476) [2025-04-21 14:08:48.299838] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:48.299911] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:641, total:657) [2025-04-21 14:08:48.299996] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:48.300033] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:641, total:657) [2025-04-21 14:08:48.300091] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:48.300116] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:48.323836] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:48.351368] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.364620] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:48.371415] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:48.371469] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.386234] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:48.386299] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:48.386330] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:48.386362] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:48.386390] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:48.387733] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1505, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:48.387783] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=285, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:48.387780] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1506, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:48.387804] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:48.387817] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:48.387848] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:48.387863] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:48.387887] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1882, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:48.387901] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1840, avg_log_submit_to_slide_time=1853) [2025-04-21 14:08:48.387928] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:48.387955] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:48.387983] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:48.388001] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1614, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:48.388018] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=8, avg_log_submit_to_flush_time=1590, avg_log_submit_to_slide_time=1605) [2025-04-21 14:08:48.388039] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:48.388070] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:48.388107] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:48.402826] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:08:48.402921] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=81] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:48.417806] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:48.419455] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1590, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:48.419505] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8262) [2025-04-21 14:08:48.419559] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:48.419597] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8262) [2025-04-21 14:08:48.419658] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=16, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:48.419684] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1729, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:48.419705] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1682, avg_log_submit_to_slide_time=1702) [2025-04-21 14:08:48.419738] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:48.419774] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8262, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:48.420114] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:08:48.429692] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:48.429770] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=65] temporary file module use no blocks [2025-04-21 14:08:48.429803] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:48.429841] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=32] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:48.429877] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=34] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254932979901, flush_io_finished_ret_:0, flush_io_finished_round_:120, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:48.430994] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:48.432713] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=74] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8262, avg_group_log_size=516) [2025-04-21 14:08:48.432758] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8262) [2025-04-21 14:08:48.451113] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:48.451165] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.451444] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.460297] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:48.474722] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.475354] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.475420] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.475750] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.486323] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:48.486415] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:48.486445] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:48.487915] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:48.494267] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:08:48.510211] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:48.510288] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:48.511992] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1568, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:48.512028] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:08:48.512075] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:48.512149] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:48.512189] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1731, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:48.512224] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=70, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:48.512261] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:48.521334] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4025, offset=63918}, end_cursor:ObLogCursor{file_id=3, log_id=4026, offset=64224}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774b0050, len:1618, log_data_len:306, seq:4025, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:48.521656] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE55-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:48.521720] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE55-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215728192213001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215728192213001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:48.523966] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:48.527870] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4026, offset=64224}, end_cursor:ObLogCursor{file_id=3, log_id=4027, offset=64521}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774b4050, len:1312, log_data_len:297, seq:4026, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:48.528149] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE55-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:48.528192] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE55-0-0] [lt=26] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215728192213001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215728192213001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:48.551532] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.555506] INFO [STORAGE.COMPACTION] schedule_all_tablets_minor (ob_tenant_tablet_scheduler.cpp:579) [620315][T1002_MergeLoop][T1002][YB420B1D7AB6-00063343B9BEFD86-0-0] [lt=29] start schedule all tablet minor merge(minor_ls_tablet_iter_={ls_idx:-1, ls_ids:[{id:1}, {id:1001}], tablet_ids:{tablet_idx:0, tablet_cnt:0, array:[], is_inited:false}, schedule_tablet_cnt:0, max_batch_tablet_cnt:50000}) [2025-04-21 14:08:48.556479] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=46] clear dtl interm result cost(us)(clear_cost=381, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:48.556930] INFO [STORAGE.COMPACTION] schedule_all_tablets_medium (ob_tenant_tablet_scheduler.cpp:1585) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8B-0-0] [lt=49] start schedule all tablet merge(merge_version=1) [2025-04-21 14:08:48.557402] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620317][T1002_Compactio][T1002][YB420B1D7AB6-00063343B84EFD89-0-0] [lt=45] InfoPoolResizeTask(cost_ts=10) [2025-04-21 14:08:48.564358] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:08:48.564434] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] submit log success(service_type_=0, last_id=1745215745197259000, limited_id=1745215745197259000) [2025-04-21 14:08:48.564468] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] submit log with lock success(service_type_=0, last_id=1745215745197259000, limited_id=1745215745197259000) [2025-04-21 14:08:48.564494] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9D-0-0] [lt=44] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215728192213002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:48.564668] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9D-0-0] [lt=133] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:48.564758] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9D-0-0] [lt=87] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:48.566374] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215745197259000, latest_scn={val:1745215728563901001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:48.566453] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=77] handle submit callback(service_type_=0, success=true, used_ts=2020, log_ts={val:1745215728563901001, v:0}, limited_id=1745215745197259000) [2025-04-21 14:08:48.566480] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=26] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:48.566501] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=20] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:48.567306] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:08:48.567353] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=37] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:48.567544] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00C9-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1745215728567116000, start_id=1745215728567116000, end_id=1745215728567116001) [2025-04-21 14:08:48.568384] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=56] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:48.572533] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:48.572583] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.574877] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F003C-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.575034] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDAF-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.575429] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB0-0-0] [lt=63][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.576599] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:48.577483] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F003F-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.577482] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB2-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.578189] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0040-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.592907] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:48.597144] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=74] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:48.603366] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:48.603409] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:48.605354] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:48.605401] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:48.607208] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D4-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.609628] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D4-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254934159935, cache_obj->added_lc()=false, cache_obj->get_object_id()=675, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:48.611034] WDIAG get_refactored (ob_hashtable.h:1120) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8D-0-0] [lt=38][errcode=-4201] hashtable not init [2025-04-21 14:08:48.611069] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8D-0-0] [lt=34] get cursor info failed(cursor_id=38, get_sessid()=3221487630) [2025-04-21 14:08:48.611268] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1745215728611165000, start_id=1745215728611165000, end_id=1745215728611165001) [2025-04-21 14:08:48.612957] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215728612953, bytes: 4611039, bw: 0.013005 MB/s, add_ts: 1000009, add_bytes: 13637 [2025-04-21 14:08:48.643324] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2025-04-21 14:08:48.644342] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:48.644402] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=58] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:48.644472] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=37] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:48.644573] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=97] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:48.644605] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:48.644632] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215724188868002, v:0}) [2025-04-21 14:08:48.644651] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:48.644675] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:48.644706] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:48.644729] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:48.644759] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:48.644791] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=30] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:48.645808] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:48.645850] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=41] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:48.645905] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:48.645977] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:48.645999] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:48.646021] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:48.646046] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:48.646067] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:48.646090] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:48.646117] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:48.646136] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:48.651605] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.655900] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:48.656028] WDIAG read_multi_row (ob_table_access_helper.h:238) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:48.657747] INFO delete_row (ob_table_access_helper.h:312) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=44] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215728656073) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215728656073) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:48.657952] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=45] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:48.660802] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:48.670776] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215728192213002, v:0}, new_max_version={val:1745215728192213002, v:0}, last_min_version={val:1745215727691730004, v:0}, last_max_version={val:1745215727691730004, v:0}, total_time_us=3335, delta_us=478560) [2025-04-21 14:08:48.670826] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215728192213002, v:0}, min_version={val:1745215728192213002, v:0}, max_version={val:1745215728192213002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:48.675835] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=41] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:48.679067] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:81) [620315][T1002_MergeLoop][T1002][YB420B1D7AB6-00063343B9BEFD86-0-0] [lt=96] MergeLoopTask(cost_ts=123603) [2025-04-21 14:08:48.688052] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=61] PNIO [ratelimit] time: 1745215728688033, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007655, add_bytes: 0 [2025-04-21 14:08:48.688242] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=57, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:48.688307] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=64] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=2044, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:48.688330] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:48.688356] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=24] [APPLY STAT CB EXECUTE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=-543, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:48.688438] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0026-0-0] [lt=80] [APPLY STAT CB TOTAL TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=1557, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:48.693511] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:48.693943] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:08:48.693983] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:48.694023] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:48.695134] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.695329] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.695953] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696004] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696120] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696181] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696182] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696248] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696259] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696303] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.696474] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:48.700741] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDE9-0-0] [lt=46] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:48.724148] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:48.736059] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE7-0-0] [lt=21] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:48.750987] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0042-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.751771] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=84] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:48.751802] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:48.751820] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.753739] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0044-0-0] [lt=54][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.756063] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0046-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.757146] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0047-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:48.762709] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFD9F-0-0] [lt=39] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:48.764592] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215728763799000, start_id=1745215728763799000, end_id=1745215728763799001) [2025-04-21 14:08:48.766004] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4684) [2025-04-21 14:08:48.766069] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=153, avg_log_gen_to_submit_time=173, avg_log_submit_to_flush_time=1593, avg_log_submit_to_slide_time=1615) [2025-04-21 14:08:48.786614] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:48.786673] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=57] try gc retain ctx [2025-04-21 14:08:48.786705] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] try to retry start_working [2025-04-21 14:08:48.786760] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] finish update min start scn(max_decided_scn={val:1745215728192213004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215718682379000, v:0}, keep_alive_scn_:{val:1745215723687543000, v:0}, update_ts_:1745215728786371}) [2025-04-21 14:08:48.787787] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:48.787983] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=122] finish update min start scn(max_decided_scn={val:1745215728192213004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215718682379000, v:0}, keep_alive_scn_:{val:1745215723687543000, v:0}, update_ts_:1745215728787554}) [2025-04-21 14:08:48.788661] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=49] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:48.789134] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215726190349001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:48.807764] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620324][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF7EFD86-0-0] [lt=43] ObArchiveSender is running(thread_index=2) [2025-04-21 14:08:48.820356] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:48.831109] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:48.833110] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:48.851769] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=14][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.861342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:48.869338] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFFB0-0-0] [lt=22] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035222244262695312e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739968279972239316e+02) [2025-04-21 14:08:48.871645] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:48.871693] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.871954] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3B-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:48.872016] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3B-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:48.900206] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:48.902264] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] get number(ret=0, service_type_=0, range=1, base_id=1745215728901716000, start_id=1745215728901716000, end_id=1745215728901716001) [2025-04-21 14:08:48.908014] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD2-0-0] [lt=40] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:48.913761] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=306] start to print blacklist info [2025-04-21 14:08:48.913941] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=39] ls blacklist refresh finish(cost_time=8927) [2025-04-21 14:08:48.924285] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:48.926543] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDEB-0-0] [lt=36] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:48.951011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=29] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000) [2025-04-21 14:08:48.951105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=92] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951338] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:48.951415] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:48.951461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=39] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951843] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:48.951888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.951960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.952959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=48] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.953990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=39] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.954982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955543] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:48.955601] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=56] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:48.955609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.955958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956238] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] update_check_range(min_check_version=11, max_check_version=12, global_version=13) [2025-04-21 14:08:48.956294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.956982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=41] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957256] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=56] current monitor number(seq_=-1) [2025-04-21 14:08:48.957280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.957980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.958988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.959951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.960996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=41] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.961943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962611] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.962953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963293] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.963953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.964991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.965975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.966960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967644] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=62] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215728192213004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=775419, in_cluster_service=true, cluster_version={val:1745215728192213003, v:0}, min_cluster_version={val:1745215728192213003, v:0}, max_cluster_version={val:1745215728192213003, v:0}, get_cluster_version_err=0, cluster_version_delta=775419, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1061, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=59843368, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:48.967702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.967978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968659] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.968940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.969985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970524] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.970950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.971935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972198] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972611] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.972971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.973937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.974979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975317] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.975999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.976951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.977971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.978954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.979966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980426] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 164 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 238 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 87 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 21 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 93 248 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 24241 [2025-04-21 14:08:48.980445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980497] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,074,872,320 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 460,386,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:48.980512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980822] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 460,386,304 used= 384,214,768 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 28 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,767,744 used= 4,194,304 count= 70 avg_used= 59,918 block_cnt= 70 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,169,792 used= 3,038,592 count= 656 avg_used= 4,632 block_cnt= 656 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,489,280 used= 1,409,512 count= 39 avg_used= 36,141 block_cnt= 39 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 7 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 601,472 used= 587,264 count= 74 avg_used= 7,936 block_cnt= 74 chunk_cnt= 13 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 378,880 used= 363,520 count= 80 avg_used= 4,544 block_cnt= 80 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 211,328 used= 206,336 count= 26 avg_used= 7,936 block_cnt= 26 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 105,664 used= 103,168 count= 13 avg_used= 7,936 block_cnt= 13 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 105,664 used= 103,168 count= 13 avg_used= 7,936 block_cnt= 13 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 9,168 used= 6,656 count= 13 avg_used= 512 block_cnt= 12 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,214,768 used= 376,080,252 count= 32,177 avg_used= 11,687 mod=SUMMARY [2025-04-21 14:08:48.980852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980871] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:08:48.980899] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:08:48.980920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.980930] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 87,228,544 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 82,300,032 used= 74,749,471 count= 3,724 avg_used= 20,072 block_cnt= 3,724 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,501,248 used= 3,294,736 count= 362 avg_used= 9,101 block_cnt= 362 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,425,280 used= 1,299,520 count= 655 avg_used= 1,984 block_cnt= 219 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 87,228,544 used= 79,345,327 count= 4,743 avg_used= 16,728 mod=SUMMARY [2025-04-21 14:08:48.980961] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:08:48.980988] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:08:48.980991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981047] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:08:48.981077] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:08:48.981080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981103] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:48.981130] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:48.981150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981156] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:08:48.981195] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,707,648 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,836,928 used= 1,793,536 count= 226 avg_used= 7,936 block_cnt= 226 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,707,648 used= 19,635,264 count= 230 avg_used= 85,370 mod=SUMMARY [2025-04-21 14:08:48.981228] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:08:48.981227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981267] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:08:48.981298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981304] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:48.981369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:48.981598] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,342,384 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:49.072793] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.075536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=2] get multi version start(ls_id={id:1001}, tablet_id={id:200789}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213921174527000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213911165280000, max_merged_snapshot=1) [2025-04-21 14:08:49.078095] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD89-0-0] [lt=2] SSTableGCTask(cost_ts=127519) [2025-04-21 14:08:49.110810] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4100) [2025-04-21 14:08:49.121325] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D7-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.124005] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D7-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254934674305, cache_obj->added_lc()=false, cache_obj->get_object_id()=676, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:49.129515] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=5900000, replace_num=100000) [2025-04-21 14:08:49.129590] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:49.151999] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.194255] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=58] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=402, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:49.209225] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=74][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:49.219780] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=28] [APPLY STAT CB APPEND COST TIME](cur_stat_count=77, stat_interval=5000000, avg (count/cost)=47, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:49.219859] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=77] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=77, stat_interval=5000000, avg (count/cost)=1805, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:49.219875] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=77, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:49.219889] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=77, stat_interval=5000000, avg (count/cost)=-510, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:49.219902] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=77, stat_interval=5000000, avg (count/cost)=1342, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:49.231536] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215729033038000, v:0}, base_version={val:1745215728832652000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215729033038000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215729231511, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:49.233208] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFA8-0-0] [lt=60] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=401, Holding Memory(MB)=68, Tenant Remain Memory(MB)=556, Usable Remain Memory(MB)=333, Last Update Limit Timestamp=1745215729232131, Is Updated=true) [2025-04-21 14:08:49.235238] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] get_max_applied_scn(scn={val:1745215729069595000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26077095}, palf_committed_end_scn_:{val:1745215729233218000, v:0}, last_check_scn_:{val:1745215729233218000, v:0}, max_applied_cb_scn_:{val:1745215729069595000, v:0}}) [2025-04-21 14:08:49.235292] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26077095}, readable_log_tail:{lsn:26077095}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:41027673, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:49.238584] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF2-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:49.238647] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF2-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:49.245675] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBF-0-0] [lt=41] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:49.245726] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDBF-0-0] [lt=44] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=54) [2025-04-21 14:08:49.252084] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.261629] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:49.262439] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:49.269808] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=79] get number(ret=0, service_type_=0, range=1, base_id=1745215729268770000, start_id=1745215729268770000, end_id=1745215729268770001) [2025-04-21 14:08:49.272056] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] get_max_applied_scn(scn={val:1745215728693381003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17342850}, palf_committed_end_scn_:{val:1745215728693381004, v:0}, last_check_scn_:{val:1745215728693381004, v:0}, max_applied_cb_scn_:{val:1745215728693381003, v:0}}) [2025-04-21 14:08:49.272119] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17342850}, readable_log_tail:{lsn:17342850}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49761918, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:49.285088] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=46] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:49.291133] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3F-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:49.291211] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE3F-0-0] [lt=74] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:49.301182] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:49.301256] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:49.301444] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:49.301647] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:49.301755] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:44, submit:7, rt:1120, total:1189) [2025-04-21 14:08:49.301793] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:SSTABLE_WHOLE_SCANNER_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:1053, bw:4312168, [delay/us]:prepare:3, schedule:40, submit:11, rt:501, total:556) [2025-04-21 14:08:49.301871] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=4, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=49999, free_result_cnt=49999, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=263, ops=0, iops=263, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:49.301937] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1053, avg_bw:4311979, [delay/us]: prepare:3, schedule:40, submit:11, device:501, total:556) [2025-04-21 14:08:49.301958] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:17, schedule:44, submit:7, device:1120, total:1189) [2025-04-21 14:08:49.302017] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:49.302089] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:602, total:618) [2025-04-21 14:08:49.302167] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:49.302206] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:602, total:618) [2025-04-21 14:08:49.302263] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:49.302287] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:49.329709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:49.344080] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:49.345400] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=57] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:49.345508] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215721174527000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:49.352184] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.365885] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=150] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4100, avg_group_log_size=372) [2025-04-21 14:08:49.367988] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=130] get_max_applied_scn(scn={val:1745215728693381004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8761129}, palf_committed_end_scn_:{val:1745215729193315000, v:0}, last_check_scn_:{val:1745215729193315000, v:0}, max_applied_cb_scn_:{val:1745215728693381004, v:0}}) [2025-04-21 14:08:49.368058] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=63] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8761129}, readable_log_tail:{lsn:8761129}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58343639, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:49.371818] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:49.371895] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.387222] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=94] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:49.387320] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:49.387374] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:49.387416] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:49.387457] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:49.388565] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1357, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:49.388619] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:49.388673] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:49.388744] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:49.388772] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1499, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:49.388794] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1446, avg_log_submit_to_slide_time=1467) [2025-04-21 14:08:49.388831] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:49.388843] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:49.388871] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1326, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:49.388908] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:49.388957] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:49.389021] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:49.389057] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:49.389071] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1446, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:49.389084] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1416, avg_log_submit_to_slide_time=1434) [2025-04-21 14:08:49.389109] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:49.389117] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:49.398226] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=48] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:49.399481] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=26] ====== traversal_flush timer task ====== [2025-04-21 14:08:49.399637] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:49.399686] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=40] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:49.399717] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=26] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=25) [2025-04-21 14:08:49.399624] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9E-0-0] [lt=44] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215729268770000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:49.399765] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9E-0-0] [lt=134] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:49.418609] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:49.419847] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1437, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:49.419896] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:49.419964] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:49.420024] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1569, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:49.420048] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1524, avg_log_submit_to_slide_time=1545) [2025-04-21 14:08:49.420102] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:49.420148] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10016, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:49.420190] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:49.430016] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=57] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:49.430068] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:49.430087] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:49.430108] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:49.430134] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254933980252, flush_io_finished_ret_:0, flush_io_finished_round_:121, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:49.431153] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:49.433709] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=98] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=10016, avg_group_log_size=556) [2025-04-21 14:08:49.433757] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=10016) [2025-04-21 14:08:49.434968] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=10605) [2025-04-21 14:08:49.435065] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10605) [2025-04-21 14:08:49.435212] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:49.435325] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:49.436179] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:49.436241] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:49.436313] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:49.436430] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=111] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:49.436478] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:49.436506] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215721425646001, v:0}) [2025-04-21 14:08:49.436527] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:49.436548] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:49.436571] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:49.436603] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:49.436627] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:49.436659] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:49.436693] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:49.436716] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:49.451557] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:49.451631] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.452259] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.463055] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:49.472259] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=200000, clean_num=200000) [2025-04-21 14:08:49.475438] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.475504] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.475792] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.475806] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.487293] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:49.487377] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:49.487425] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:49.498443] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=48] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:49.511165] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=69] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:49.511224] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:49.512614] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1407, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:49.512650] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4100) [2025-04-21 14:08:49.512690] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=78, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:49.512758] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:49.512797] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1768, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:49.512831] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:49.512870] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=86] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4100, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:49.529883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:49.533856] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4027, offset=64521}, end_cursor:ObLogCursor{file_id=3, log_id=4028, offset=64827}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774b8050, len:1015, log_data_len:306, seq:4027, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:49.534176] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE56-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:49.534272] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE56-0-0] [lt=65] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215729193315001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215729193315001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:49.540268] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4028, offset=64827}, end_cursor:ObLogCursor{file_id=3, log_id=4029, offset=65124}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774bc050, len:709, log_data_len:297, seq:4028, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:49.540537] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE56-0-0] [lt=48] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:49.540598] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE56-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215729193315001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215729193315001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:49.552327] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.552605] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFA-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:49.553047] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFA-0-0] [lt=35] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215729552999, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:49.553093] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFA-0-0] [lt=44] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215729552532}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215729552999, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:49.573204] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=2, size_used=0, mem_used=2079744) [2025-04-21 14:08:49.573302] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=89] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.576533] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:49.576690] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:08:49.577884] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=59] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:49.577987] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215725571082000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:49.578991] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB4-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.578996] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0049-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.579656] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F004A-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.581174] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=58] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:49.581239] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:08:49.581263] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:49.581291] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:49.581316] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254934131410, flush_io_finished_ret_:0, flush_io_finished_round_:121, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:49.581720] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F004E-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.581787] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC2-0-0] [lt=48] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:49.581802] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB5-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.582214] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F004F-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.586026] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] skip repeat study(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215669589413, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215729586022, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:49.587658] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=63] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669580512000, snapshot_type=1, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:49.587705] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669124264000, snapshot_type=2, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:49.587731] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669124264000, snapshot_type=3, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:49.587753] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=18] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:08:49.587990] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=13] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215669589413, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215669124264000, v:0}, reserved_snapshot={val:1745215669124264000, v:0}) [2025-04-21 14:08:49.588038] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=46] multi-version garbage collector refresh successfully(this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215669589413, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215669124264000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215669581833, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:08:49.588079] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40] repeat refresh successfully(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215729588078, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215729586089, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:08:49.588112] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] skip repeat reclaim(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215729588078, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215729588110, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:08:49.588756] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:08:49.593082] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:49.603715] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:49.603761] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:49.606022] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D9-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.606181] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:49.606220] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:49.608445] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00D9-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254935158753, cache_obj->added_lc()=false, cache_obj->get_object_id()=677, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:49.610669] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=86] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:49.618743] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=50] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:49.618793] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] try gc retain ctx [2025-04-21 14:08:49.618809] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:49.618867] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215729469527000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215719523153001, v:0}, keep_alive_scn_:{val:1745215724477445001, v:0}, update_ts_:1745215729618359}) [2025-04-21 14:08:49.619843] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=35] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215737945792000, latest_log_ts:{val:1745215721425646001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:49.619968] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215729619964, bytes: 4626191, bw: 0.014349 MB/s, add_ts: 1007011, add_bytes: 15152 [2025-04-21 14:08:49.652403] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.652865] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:49.652939] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=54] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=23) [2025-04-21 14:08:49.653989] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=28] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:49.654049] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=45] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:49.654080] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=28] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:49.654096] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=13] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=23) [2025-04-21 14:08:49.671418] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=116] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215729193315002, v:0}, new_max_version={val:1745215729193315002, v:0}, last_min_version={val:1745215728693381004, v:0}, last_max_version={val:1745215728693381004, v:0}, total_time_us=3226, delta_us=478099) [2025-04-21 14:08:49.671466] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215729193315002, v:0}, min_version={val:1745215729193315002, v:0}, max_version={val:1745215729193315002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:49.672765] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:49.684433] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFDF4-0-0] [lt=49][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:08:49.688779] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:49.688838] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=44] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=25) [2025-04-21 14:08:49.692160] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=37] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:49.692212] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=41] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:49.692235] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=25) [2025-04-21 14:08:49.694543] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=60] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:49.694599] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=407, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:49.694931] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215729694914], gts:1745215729693956000, latest_srr:[mts=1745215729694914]}) [2025-04-21 14:08:49.695008] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.695025] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.695500] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.695643] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.695694] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1745215729695690, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007657, add_bytes: 0 [2025-04-21 14:08:49.696013] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696063] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696062] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696107] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696107] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696431] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.696563] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:49.730029] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:49.752583] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.755223] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0051-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.758171] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0053-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.761592] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0056-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.762293] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0057-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:49.767495] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:49.767595] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=71] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1563, avg_log_submit_to_slide_time=1590) [2025-04-21 14:08:49.788780] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:49.812933] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] ====== check clog disk timer task ====== [2025-04-21 14:08:49.813028] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=65] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:49.820432] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:49.826266] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:49.826331] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:08:49.826349] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:49.826377] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:49.826402] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254934376470, flush_io_finished_ret_:0, flush_io_finished_round_:121, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:49.831293] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:49.833926] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:49.842267] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:08:49.852654] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.868846] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65755280}, readable_log_tail:{lsn:65755280}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1349488, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:49.868983] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=135] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:49.869094] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=85] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:49.872025] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:49.872089] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.873787] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:49.873991] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3D-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:49.874056] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3D-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:49.879455] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=13, gc_interval=10000000) [2025-04-21 14:08:49.879535] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=44] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:49.879571] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=25] gc_check_member_list_ cost time(ret=0, time_us=71) [2025-04-21 14:08:49.879600] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=23] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:49.879627] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:49.879653] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:49.879675] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=25) [2025-04-21 14:08:49.879693] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyHandler start process [2025-04-21 14:08:49.891330] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=45] finish to resize log external storage handler(current_ts=1745215729891324, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:49.897272] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:49.897319] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:49.897339] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:49.897364] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:49.900604] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=328, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}]) [2025-04-21 14:08:49.901318] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=709] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:49.915482] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=69] blacklist_loop exec finished(cost_time=22, is_enabled=true, send_cnt=0) [2025-04-21 14:08:49.930161] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:49.943927] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=118] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:49.951782] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:49.951844] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:49.952725] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:49.955158] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=44] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14507, max_lsn:65755402, max_scn:{val:1745215729765294001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65755402}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65755280}, last_submit_end_lsn:{lsn:65755402}, last_submit_log_id:14507, last_submit_log_pid:3, max_flushed_lsn:{lsn:65755280}, max_flushed_end_lsn:{lsn:65755402}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65755402}, last_slide_log_id:14507, last_slide_scn:{val:1745215729765294001, v:0}, last_slide_lsn:{lsn:65755280}, last_slide_end_lsn:{lsn:65755402}, last_slide_log_pid:3, last_slide_log_accum_checksum:150277622, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14508, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65755402}, readable_log_tail:{lsn:65755402}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1349366, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:49.955433] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=268] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215729912884, last_flushed_end_lsn:{lsn:65755402}}]) [2025-04-21 14:08:49.955460] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14508, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215729912884, last_flushed_end_lsn:{lsn:65755402}}]) [2025-04-21 14:08:49.957410] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=39] current monitor number(seq_=-1) [2025-04-21 14:08:49.976276] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:50.027443] INFO [STORAGE.COMPACTION] add_event_and_diagnose (ob_medium_loop.cpp:203) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8B-0-0] [lt=36] finish schedule all tablet merge(merge_version_=1, schedule_stats_={all_ls_weak_read_ts_ready:true, start_timestamp:0}, loop_cnt=0, tenant_merge_finish=true, is_scan_all_tablet_finish=true, schedule_tablet_cnt={schedule_dag_cnt:0, submit_clog_cnt:0, finish_cnt:2152, loop_tablet_cnt:2152, force_freeze_cnt:0, wait_rs_validate_cnt:0}, time_guard=GET_TABLET=40.79ms|INIT_TABLET_STATUS=138.81ms|SCHEDULE_NEXT_MEDIUM=11.55ms|SCHEDULE_TABLET_EXECUTE=1.28s|) [2025-04-21 14:08:50.027532] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:95) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8B-0-0] [lt=83] MediumLoopTask(cost_ts=1470647) [2025-04-21 14:08:50.027568] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8C-0-0] [lt=18] MediumCheckTask(cost_ts=9) [2025-04-21 14:08:50.033450] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFAC-0-0] [lt=52] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035373592376708984e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.739463619626333184e+02) [2025-04-21 14:08:50.034999] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=48] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:50.052806] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.055249] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=366) [2025-04-21 14:08:50.073418] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:50.073469] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.074359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:50.075677] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=55] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:08:50.075765] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=62] BlockGCTimerTask success(ret=0, cost_time_us=12, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:50.111694] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:50.128092] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DB-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.130291] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:50.130428] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DB-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254935680736, cache_obj->added_lc()=false, cache_obj->get_object_id()=678, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:50.152875] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.195197] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=35] ts response task statistics(alloc_count=2670, free_count=1334) [2025-04-21 14:08:50.232272] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215730032915000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199347, in_cluster_service=true, cluster_version={val:1745215729832812000, v:0}, min_cluster_version={val:1745215729832812000, v:0}, max_cluster_version={val:1745215729832812000, v:0}, get_cluster_version_err=0, cluster_version_delta=399450, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1073, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=65052855, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:50.240467] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF3-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:50.240521] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF3-0-0] [lt=50] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:50.252944] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.275034] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=170] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:50.292897] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE40-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:50.292968] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE40-0-0] [lt=67] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:50.303419] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:50.303480] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:50.303651] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:50.303830] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:50.303908] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:11, schedule:17, submit:5, rt:1243, total:1277) [2025-04-21 14:08:50.303934] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:SSTABLE_WHOLE_SCANNER_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:1095, bw:4483551, [delay/us]:prepare:3, schedule:36, submit:10, rt:471, total:523) [2025-04-21 14:08:50.303994] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=273, ops=0, iops=273, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:50.304051] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1095, avg_bw:4483828, [delay/us]: prepare:3, schedule:36, submit:10, device:471, total:523) [2025-04-21 14:08:50.304066] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:11, schedule:17, submit:5, device:1243, total:1277) [2025-04-21 14:08:50.304119] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:50.304186] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:581, total:593) [2025-04-21 14:08:50.304260] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:50.304292] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:581, total:593) [2025-04-21 14:08:50.304345] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:50.304367] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:50.330414] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:50.353018] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.366106] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:08:50.369495] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:50.370897] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215730370031000, start_id=1745215730370031000, end_id=1745215730370031001) [2025-04-21 14:08:50.372205] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:50.372274] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.387913] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:50.387973] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:50.388004] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:50.388035] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:50.388060] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:50.389207] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1347, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:50.389261] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:50.389274] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:50.389332] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:50.389362] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1472, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:50.389377] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1425, avg_log_submit_to_slide_time=1443) [2025-04-21 14:08:50.389404] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:50.389416] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:50.389441] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1236, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:50.389464] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:50.389493] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:50.389524] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:50.389555] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:50.389575] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1327, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:50.389594] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1301, avg_log_submit_to_slide_time=1318) [2025-04-21 14:08:50.389619] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:50.389625] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:50.403099] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=33] ====== check clog disk timer task ====== [2025-04-21 14:08:50.403148] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=42] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:50.419466] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=97] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:50.420274] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:50.420890] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1328, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:50.420942] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:50.421025] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:50.421067] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1455, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:50.421083] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1411, avg_log_submit_to_slide_time=1432) [2025-04-21 14:08:50.421128] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:50.421173] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8374, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:50.430262] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:50.430335] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=62] temporary file module use no blocks [2025-04-21 14:08:50.430355] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:50.430396] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:50.430417] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254934980498, flush_io_finished_ret_:0, flush_io_finished_round_:122, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:50.431321] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:50.434354] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8374, avg_group_log_size=492) [2025-04-21 14:08:50.434408] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8374) [2025-04-21 14:08:50.435589] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8374) [2025-04-21 14:08:50.435681] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8374) [2025-04-21 14:08:50.451959] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:50.452013] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.453090] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.475172] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.475167] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.475521] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.475515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:50.475583] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.487992] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:50.488070] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:50.488108] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:50.496026] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:08:50.511944] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:50.512003] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:50.513441] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1309, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:50.513482] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4080) [2025-04-21 14:08:50.513522] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:50.513610] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:50.513678] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1447, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:50.513719] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:50.513779] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4080, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:50.530569] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:50.546429] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4029, offset=65124}, end_cursor:ObLogCursor{file_id=3, log_id=4030, offset=65430}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774c0050, len:412, log_data_len:306, seq:4029, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:50.546847] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE57-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:50.546933] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE57-0-0] [lt=54] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215730195314001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215730195314001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:50.553168] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.555135] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=63] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4030, offset=65430}, end_cursor:ObLogCursor{file_id=3, log_id=4031, offset=65727}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774c4050, len:4202, log_data_len:297, seq:4030, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:50.555505] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE57-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:50.555575] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE57-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215730195314001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215730195314001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:50.567591] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=37] ====== check clog disk timer task ====== [2025-04-21 14:08:50.567639] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:50.573617] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:50.573668] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.576765] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:50.581472] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:50.581525] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:50.581550] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:50.581589] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=37] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:50.581616] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254935131677, flush_io_finished_ret_:0, flush_io_finished_round_:122, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:50.583165] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB6-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.583327] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0059-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.583504] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD97-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.585766] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F005B-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.585860] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD98-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.586038] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=46] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:50.586475] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F005C-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.589621] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:50.593246] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:50.603734] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:50.603777] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:50.605639] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:50.605675] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:50.607410] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:50.627587] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215730627581, bytes: 4638963, bw: 0.012088 MB/s, add_ts: 1007617, add_bytes: 12772 [2025-04-21 14:08:50.635936] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:50.653239] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.660830] INFO [STORAGE] refresh_queuing_mode (ob_tenant_tablet_stat_mgr.cpp:1160) [620226][T1002_TabletSta][T1002][Y0-0000000000000000-0-0] [lt=664] refresh queuing mode(ret=0, tenant_id=1002, stream_cnt=0, update_schema_cnt=0, cost_time=34) [2025-04-21 14:08:50.660906] INFO [STORAGE] runTimerTask (ob_tenant_tablet_stat_mgr.cpp:1210) [620226][T1002_TabletSta][T1002][Y0-0000000000000000-0-0] [lt=72] TenantTabletStatMgr refresh all tablet stream(MTL_ID()=1002, interval_step=1, global_iter_pool={is_inited:false, is_washing:false, is_disabled:false, get_cnt:0, tenant_id:1002, bucket_cnt:0, tenant_mem_user_limit:1073741824, tenant_mem_user_hold:279248896, cached_node_array:0x7f3c385d30f0}) [2025-04-21 14:08:50.673310] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215730195314002, v:0}, new_max_version={val:1745215730195314002, v:0}, last_min_version={val:1745215729693956004, v:0}, last_max_version={val:1745215729693956004, v:0}, total_time_us=4419, delta_us=477992) [2025-04-21 14:08:50.673373] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=60] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215730195314002, v:0}, min_version={val:1745215730195314002, v:0}, max_version={val:1745215730195314002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:50.673493] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=50] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:50.675993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:50.689869] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17348654, this={dio_aligned_buf:{buf_write_offset:2216, buf_padding_size:1880, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2646, truncate_used_ts:992}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17346560, buf_len=122, total_write_size=15223, total_write_size_after_dio=421888, ob_pwrite_used_ts=159355, count=99, each_pwrite_cost=1609) [2025-04-21 14:08:50.695100] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.695525] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.695525] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.695640] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=14] ====== tenant freeze timer task ====== [2025-04-21 14:08:50.695677] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:50.695729] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:50.695728] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=61] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.695809] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:50.695856] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=33] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215730695843], gts:1745215730695767000, latest_srr:[mts=1745215730695843]}) [2025-04-21 14:08:50.696077] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696115] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696138] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696157] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696186] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696228] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.696657] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:50.698790] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=50] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:50.699984] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:50.700082] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215728763799000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:50.703235] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=29] PNIO [ratelimit] time: 1745215730703230, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007540, add_bytes: 0 [2025-04-21 14:08:50.730750] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=82] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:50.747155] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=48] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:50.753321] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.759938] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F005E-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.762632] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0060-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.767262] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0063-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.767992] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0064-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:50.768063] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4080) [2025-04-21 14:08:50.768129] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1442, avg_log_submit_to_slide_time=1463) [2025-04-21 14:08:50.788905] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:50.820499] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:08:50.826528] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:50.826594] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:08:50.826613] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:50.826643] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:50.826670] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254935376765, flush_io_finished_ret_:0, flush_io_finished_round_:122, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:50.831478] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:50.834215] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:50.853404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.863762] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=51][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:50.872317] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:50.872369] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.876502] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:50.876719] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3E-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:50.876819] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3E-0-0] [lt=94] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:50.924130] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=42] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:50.930897] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:50.940956] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=33] LogLoopThread round_cost_time(us)(round_cost_time=23) [2025-04-21 14:08:50.952155] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:50.952218] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:50.953477] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:50.957561] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=51] current monitor number(seq_=-1) [2025-04-21 14:08:51.013907] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:51.013964] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=56] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:51.013972] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB9-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:51.014023] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDB9-0-0] [lt=47] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:51.028044] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=41] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:51.028174] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=40] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:08:51.034453] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFB1-0-0] [lt=36] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:51.035138] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:51.038918] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=24] === Run print tenant memory usage task === [2025-04-21 14:08:51.038990] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=34] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 135,151,616 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,731,038,312 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,074,872,320 max_mem_memstore_can_get_now= 2,460,925,952 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,731,038,312 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,144,060 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 547,336,192 max_mem_memstore_can_get_now= 360,720,366 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,731,038,312 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,735,140 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 647,716,864 max_mem_memstore_can_get_now= 313,675,764 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:08:51.039077] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=24] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,180,355,584 total_hold= 3,351,248,896 used= 3,113,041,920 freelists_hold= 67,313,664 total_maps= 1,203 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,866,857,472 divisive_memory_used= 135,151,616 virtual_memory_used= 4,555,751,424 [CHUNK_MGR] 2 MB_CACHE: hold= 18,874,368 free= 9 pushes= 319,216 pops= 319,207 maps= 1,069 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 119 pops= 117 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:08:51.039123] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=20] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:08:51.053565] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.058700] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215721055829, end_time=1745215731058696, dag_status={}) [2025-04-21 14:08:51.058751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=47] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058773] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058795] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058876] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058895] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058913] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:51.058926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.058950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.058969] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.058988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059007] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059026] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059064] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059083] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059102] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059120] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059138] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059158] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059176] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059214] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059251] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059288] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059326] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059345] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059383] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059420] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059439] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059429] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD91-0-0] [lt=40] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:08:51.059459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059480] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059498] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059517] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059535] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059553] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059571] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059589] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059608] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059626] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059665] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059685] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059704] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059743] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059762] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059782] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059801] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059875] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059893] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059911] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059929] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.059984] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060002] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060038] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060057] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060075] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060093] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060112] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060130] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060168] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060187] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060206] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060226] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:51.060247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:51.060265] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:51.060284] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:51.060301] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:51.060317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:51.060333] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:51.060349] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:51.060364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:51.060380] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:51.060396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:51.060414] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:51.073784] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:51.073830] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.076974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:51.112429] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4080) [2025-04-21 14:08:51.112528] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:51.112675] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=142] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:51.112702] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:51.112719] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:51.114187] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=39] [APPLY STAT CB APPEND COST TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=59, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:51.114234] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=45] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1620, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:51.114249] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:51.114262] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-475, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:51.114283] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B5BEFDBE-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1205, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:51.115914] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:08:51.116251] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=332] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:51.116599] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=32] success to update min reserved snapshot(reserved_snapshot=1745213921174527000, duration=1800, snapshot_gc_ts=1745215721174527000) [2025-04-21 14:08:51.119362] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8767421, this={dio_aligned_buf:{buf_write_offset:2093, buf_padding_size:2003, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3085, truncate_used_ts:1281}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8765440, buf_len=112, total_write_size=21541, total_write_size_after_dio=430080, ob_pwrite_used_ts=153998, count=100, each_pwrite_cost=1539) [2025-04-21 14:08:51.119569] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=59] update reserved snapshot finished(cost_ts=2976, reserved_snapshot=1745213921174527000) [2025-04-21 14:08:51.126355] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=35] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:51.127690] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9E-0-0] [lt=37] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=92) [2025-04-21 14:08:51.127916] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215731126970000, start_id=1745215731126970000, end_id=1745215731126970001) [2025-04-21 14:08:51.131031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:51.133861] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DC-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.136285] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DC-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254936686593, cache_obj->added_lc()=false, cache_obj->get_object_id()=679, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:51.153634] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.164318] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=38] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:08:51.165666] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=43] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:08:51.165705] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=36] no transfer partition job [2025-04-21 14:08:51.165725] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=15] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:08:51.168202] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=17] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:08:51.168257] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=41] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:08:51.168307] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD91-0-0] [lt=43] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:08:51.196363] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215731196326], gts:1745215731195316000, latest_srr:[mts=1745215731196326]}) [2025-04-21 14:08:51.242475] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF4-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:51.242534] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF4-0-0] [lt=55] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:51.246269] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC0-0-0] [lt=34] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:51.246328] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC0-0-0] [lt=50] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=61) [2025-04-21 14:08:51.253713] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.270621] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=86] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:51.277516] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:51.294520] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE41-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:51.294582] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE41-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:51.305350] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:51.305407] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:51.305589] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:51.305765] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:51.305839] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12264, [delay/us]:prepare:18, schedule:38, submit:9, rt:1459, total:1525) [2025-04-21 14:08:51.305907] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:51.305961] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12264, [delay/us]: prepare:18, schedule:38, submit:9, device:1459, total:1525) [2025-04-21 14:08:51.306015] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:51.306082] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:600, total:616) [2025-04-21 14:08:51.306157] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:51.306188] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:600, total:616) [2025-04-21 14:08:51.306243] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:51.306263] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:51.338323] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6000000, replace_num=100000) [2025-04-21 14:08:51.338393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:51.353786] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.367056] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4080, avg_group_log_size=370) [2025-04-21 14:08:51.372469] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:51.372522] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.388631] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:51.388713] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:08:51.388747] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:51.388778] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:51.388804] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:51.390269] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1421, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:51.390317] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1210) [2025-04-21 14:08:51.390359] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=119, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:51.390343] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1478, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:51.390392] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1210) [2025-04-21 14:08:51.390408] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:51.390453] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:51.390490] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1611, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:51.390513] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1584, avg_log_submit_to_slide_time=1599) [2025-04-21 14:08:51.390551] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:51.390565] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1210, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:51.390588] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2449) [2025-04-21 14:08:51.390618] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:51.390638] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1643, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:51.390658] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1597, avg_log_submit_to_slide_time=1612) [2025-04-21 14:08:51.390694] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:51.390699] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:51.420270] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:51.420381] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:51.421791] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1465, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:51.421845] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:51.421885] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:51.421927] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1595, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:51.421942] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1549, avg_log_submit_to_slide_time=1569) [2025-04-21 14:08:51.421976] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:51.422013] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8657, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:51.430565] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:51.430619] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:51.430638] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:51.430667] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:51.430707] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254935980781, flush_io_finished_ret_:0, flush_io_finished_round_:123, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:51.431495] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:51.434883] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8196, avg_group_log_size=512) [2025-04-21 14:08:51.434928] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8657) [2025-04-21 14:08:51.434950] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] submit log success(service_type_=0, last_id=1745215747945792000, limited_id=1745215747945792000) [2025-04-21 14:08:51.434976] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] submit log with lock success(service_type_=0, last_id=1745215747945792000, limited_id=1745215747945792000) [2025-04-21 14:08:51.436180] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8196) [2025-04-21 14:08:51.436250] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8196) [2025-04-21 14:08:51.436352] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=11] update id meta(ret=0, service_type=0, limited_id=1745215747945792000, latest_scn={val:1745215731434521001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:51.436432] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=79] handle submit callback(service_type_=0, success=true, used_ts=1483, log_ts={val:1745215731434521001, v:0}, limited_id=1745215747945792000) [2025-04-21 14:08:51.436511] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=77] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:51.436534] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:51.437062] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215731436676000, start_id=1745215731436676000, end_id=1745215731436676001) [2025-04-21 14:08:51.452345] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:51.452404] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.453869] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.469492] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=24] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215731183585000, v:0}, base_version={val:1745215730695767002, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215731183585000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215731469468, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:51.475269] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.475560] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.475622] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.476017] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.478009] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:51.479129] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=15] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:08:51.479216] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=78] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:08:51.479246] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=26] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:08:51.479283] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=34] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:51.481995] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=37] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:08:51.483653] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=40] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:08:51.485133] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=39] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:08:51.485172] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:08:51.486465] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:08:51.486563] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:51.486594] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=29] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:51.487345] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=400000, clean_num=200000) [2025-04-21 14:08:51.490867] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=24] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:08:51.492344] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:08:51.492382] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:08:51.493707] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:51.493805] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=32] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:51.493838] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=30] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:51.498178] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:08:51.499675] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=39] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:08:51.499713] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:08:51.501029] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:08:51.501141] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=34] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:08:51.501168] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:08:51.501203] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=23] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:51.501274] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=61] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:08:51.501297] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=22] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:51.501330] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:08:51.501364] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=32] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:08:51.501386] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:08:51.501404] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:51.501431] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:51.501455] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:08:51.501476] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:08:51.501494] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:08:51.501520] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:08:51.501543] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=22] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:08:51.502754] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=16] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:51.502800] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=44] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:51.502817] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:08:51.502868] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=13] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:08:51.502894] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=25] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:08:51.502909] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=14] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:08:51.502934] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=20] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:08:51.502963] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD93-0-0] [lt=27] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:08:51.512699] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:51.512773] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:51.514525] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1936, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:51.514573] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:08:51.514608] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:51.514665] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:51.514728] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=62] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2079, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:51.514756] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=60, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:51.514799] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:51.538529] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:51.553958] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.562549] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4031, offset=65727}, end_cursor:ObLogCursor{file_id=3, log_id=4032, offset=66033}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774c8050, len:3905, log_data_len:306, seq:4031, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:51.562965] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE58-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:51.563049] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE58-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215731196383000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215731196383000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:51.566606] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE58-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215731565867000, start_id=1745215731565867000, end_id=1745215731565867001) [2025-04-21 14:08:51.569952] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=81] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4032, offset=66033}, end_cursor:ObLogCursor{file_id=3, log_id=4033, offset=66330}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774cc050, len:3599, log_data_len:297, seq:4032, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:51.570307] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE58-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:51.570393] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE58-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215731196383001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215731196383001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:51.573993] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:51.574064] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.576833] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=57] gc stale ls task succ [2025-04-21 14:08:51.587417] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0066-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.587475] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC3-0-0] [lt=47] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:51.587583] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDB9-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.587659] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD99-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.588910] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2571) [2025-04-21 14:08:51.588978] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1332, avg_group_log_size=121) [2025-04-21 14:08:51.589023] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1332) [2025-04-21 14:08:51.590295] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0068-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.590304] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDBB-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.590419] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD9B-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.590545] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2449) [2025-04-21 14:08:51.593413] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:51.603883] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:51.603934] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:51.605843] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:51.605884] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:51.635053] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1745215731634399000, start_id=1745215731634399000, end_id=1745215731634399001) [2025-04-21 14:08:51.635220] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1745215731635214, bytes: 4653186, bw: 0.013461 MB/s, add_ts: 1007633, add_bytes: 14223 [2025-04-21 14:08:51.654040] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.682920] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F006A-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.686655] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215731685833000, start_id=1745215731685833000, end_id=1745215731685833001) [2025-04-21 14:08:51.687829] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:51.688771] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F006E-0-0] [lt=67][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.694496] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.694563] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=49] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.695532] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.695567] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.695621] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.695689] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.695816] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.696128] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.696257] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.696318] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.696729] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:51.696860] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1745215731695825000, start_id=1745215731695825000, end_id=1745215731695825001) [2025-04-21 14:08:51.696936] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=52] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:51.703039] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDEB-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:51.710850] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215731710846, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2025-04-21 14:08:51.738709] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:51.739583] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDE9-0-0] [lt=55] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:51.754173] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:51.754204] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:51.754222] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.764131] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0070-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.767235] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0072-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.768914] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:51.768983] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=2010, avg_log_submit_to_slide_time=2031) [2025-04-21 14:08:51.769399] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215731566932000, v:0}, new_max_version={val:1745215731566932000, v:0}, last_min_version={val:1745215731366477000, v:0}, last_max_version={val:1745215731366477000, v:0}, total_time_us=3847, delta_us=202464) [2025-04-21 14:08:51.769448] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215731566932000, v:0}, min_version={val:1745215731566932000, v:0}, max_version={val:1745215731566932000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:51.772343] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0075-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.772923] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0076-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:51.789043] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:51.798204] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=49] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:08:51.804830] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:51.804957] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:51.806517] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=20] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215731804978) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215731804978) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:51.807548] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=33][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:51.809444] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=28] ====== traversal_flush timer task ====== [2025-04-21 14:08:51.809534] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9F-0-0] [lt=34] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:51.809650] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFD9F-0-0] [lt=109] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:51.813172] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] ====== check clog disk timer task ====== [2025-04-21 14:08:51.813212] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=32] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:51.820568] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=69] gc stale ls task succ [2025-04-21 14:08:51.831633] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:51.835147] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:51.836750] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:51.841448] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:08:51.842441] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:51.842497] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=53] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:51.842557] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:51.842668] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=106] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:51.842722] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=46] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:51.842753] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=27] get rec log scn(service_type_=0, rec_log_ts={val:1745215728563901001, v:0}) [2025-04-21 14:08:51.842773] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:51.842792] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:51.842822] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:51.842868] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:51.842891] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:51.842922] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:51.842952] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:51.842971] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:51.843788] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=58] ====== tenant freeze timer task ====== [2025-04-21 14:08:51.848764] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=47] clear dtl interm result cost(us)(clear_cost=3426, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:51.854180] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:51.872617] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:51.872670] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.878311] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3F-0-0] [lt=25] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:51.878377] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE3F-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:51.888380] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:51.907372] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:51.907502] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=47][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:51.908056] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD4-0-0] [lt=28] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:51.913560] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=47] ls blacklist refresh finish(cost_time=8445) [2025-04-21 14:08:51.928756] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDED-0-0] [lt=59] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:51.932664] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=59] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:51.938853] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:51.952387] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:51.952462] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:51.952513] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:51.954247] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.003058] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=74] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:08:52.035135] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFB6-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:52.035276] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:52.052788] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:52.052962] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=111] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:52.053040] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=75] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=198, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:52.053153] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=43] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=647716864, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=426024960, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:52.053254] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=50] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:52.053304] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=47] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=26, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:52.054337] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.074187] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:52.074241] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.088889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:52.113057] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:52.113104] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] try gc retain ctx [2025-04-21 14:08:52.113119] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:08:52.113167] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215731966661000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215722055322001, v:0}, keep_alive_scn_:{val:1745215726963172001, v:0}, update_ts_:1745215732112183}) [2025-04-21 14:08:52.114109] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:52.114239] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=91] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:52.133857] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215732035075000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215732133790}, version_delta=98778) [2025-04-21 14:08:52.138991] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:52.140029] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DD-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.142478] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DD-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254937692785, cache_obj->added_lc()=false, cache_obj->get_object_id()=680, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.154404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.165850] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215731966661000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199178, in_cluster_service=true, cluster_version={val:1745215731765380000, v:0}, min_cluster_version={val:1745215731765380000, v:0}, max_cluster_version={val:1745215731765380000, v:0}, get_cluster_version_err=0, cluster_version_delta=400459, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1122, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=69695976, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:52.197459] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=393, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:52.244581] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF5-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:52.244644] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF5-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:52.254475] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.289467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:52.296289] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE43-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:52.296357] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE43-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:52.307569] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:52.307644] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:52.307814] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:52.308006] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:52.308093] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:22, schedule:36, submit:9, rt:1549, total:1617) [2025-04-21 14:08:52.308173] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:52.308242] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:22, schedule:36, submit:9, device:1549, total:1617) [2025-04-21 14:08:52.308310] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:52.308388] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:693, total:706) [2025-04-21 14:08:52.308466] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:52.308504] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:693, total:706) [2025-04-21 14:08:52.308568] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:52.308594] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:52.339096] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:52.351174] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=35] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:52.352392] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=52] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:52.352496] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215731182505000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:52.354546] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.367886] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3525, avg_group_log_size=352) [2025-04-21 14:08:52.372788] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:52.372843] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.389542] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:52.389615] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:52.389647] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:52.389686] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:52.389732] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:52.391202] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1451, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:52.391246] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1720) [2025-04-21 14:08:52.391265] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1472, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:52.391283] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:52.391309] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:52.391324] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1720) [2025-04-21 14:08:52.391429] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=77] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:52.391460] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1578, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:52.391482] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1544, avg_log_submit_to_slide_time=1566) [2025-04-21 14:08:52.391520] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:52.391551] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:08:52.391535] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1720, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:52.391582] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:52.391602] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1638, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:52.391623] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1594, avg_log_submit_to_slide_time=1608) [2025-04-21 14:08:52.391643] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:52.391650] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:52.403317] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:08:52.403382] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=53] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:52.420461] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=33] gc stale ls task succ [2025-04-21 14:08:52.421082] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:52.422555] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1387, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:52.422638] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=71] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:52.422721] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:52.422766] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1591, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:52.422782] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=81, avg_log_gen_to_submit_time=99, avg_log_submit_to_flush_time=1471, avg_log_submit_to_slide_time=1491) [2025-04-21 14:08:52.422824] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:52.422860] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8389, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:52.430847] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:52.430898] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:52.430916] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:52.430937] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:52.430960] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254936981066, flush_io_finished_ret_:0, flush_io_finished_round_:124, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:52.431673] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=50] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:52.435933] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8850, avg_group_log_size=520) [2025-04-21 14:08:52.435977] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8389) [2025-04-21 14:08:52.437178] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8850) [2025-04-21 14:08:52.437268] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8850) [2025-04-21 14:08:52.452632] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:52.452688] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.454602] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.474389] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.475548] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.475624] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.475899] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.490044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:52.497629] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:08:52.513409] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:52.513475] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:52.514907] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1361, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:52.514946] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3525) [2025-04-21 14:08:52.514983] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:52.515034] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:52.515086] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1504, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:52.515125] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=57, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:52.515166] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3525, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:52.539249] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:52.554700] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.568192] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:08:52.568246] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:52.574375] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:52.574432] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.576338] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4033, offset=66330}, end_cursor:ObLogCursor{file_id=3, log_id=4034, offset=66636}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774d0050, len:3302, log_data_len:306, seq:4033, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:52.576745] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE59-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:52.576826] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE59-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215732197021002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215732197021002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:52.576929] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:08:52.581832] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:52.581890] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:08:52.581908] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:52.581945] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:52.581968] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254937132067, flush_io_finished_ret_:0, flush_io_finished_round_:124, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:52.583048] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=72] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4034, offset=66636}, end_cursor:ObLogCursor{file_id=3, log_id=4035, offset=66933}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774d4050, len:2996, log_data_len:297, seq:4034, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:52.583373] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE59-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:52.583444] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE59-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215732197021002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215732197021002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:52.583989] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:52.585256] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:52.585355] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215725571082000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:52.589710] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:52.589785] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1720, avg_group_log_size=191) [2025-04-21 14:08:52.589818] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1720) [2025-04-21 14:08:52.590954] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:52.591676] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0078-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.591705] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDBC-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.592031] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0079-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.593576] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:52.594038] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDBE-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.594044] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD9D-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.594040] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F007B-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.600962] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:52.601040] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=58] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=25) [2025-04-21 14:08:52.603261] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:52.603948] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:52.603992] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:52.605750] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:52.605787] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:52.616674] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:52.617261] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DF-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.620577] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00DF-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254938170879, cache_obj->added_lc()=false, cache_obj->get_object_id()=681, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.622091] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E3-0-0] [lt=55][errcode=-4201] hashtable not init [2025-04-21 14:08:52.622139] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E3-0-0] [lt=45] get cursor info failed(cursor_id=39, get_sessid()=3221487630) [2025-04-21 14:08:52.622312] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215732621963000, start_id=1745215732621963000, end_id=1745215732621963001) [2025-04-21 14:08:52.642822] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215732642817, bytes: 4667261, bw: 0.013322 MB/s, add_ts: 1007603, add_bytes: 14075 [2025-04-21 14:08:52.654762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.665663] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=35] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26106877}, readable_log_tail:{lsn:26106877}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40997891, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:52.665879] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=214] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:08:52.665951] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=38] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:52.685278] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] [COMPACTION DAG STATUS] (start_time=1745215722682556, end_time=1745215732685273, dag_status={}) [2025-04-21 14:08:52.685330] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=48] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685354] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685382] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685394] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685407] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685419] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685443] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:52.685456] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685475] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685489] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685503] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685544] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685558] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685572] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685613] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685627] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685641] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685655] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685697] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685725] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685752] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685765] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685777] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685790] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685817] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685830] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685843] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685870] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685884] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685912] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685925] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685938] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685952] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685978] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.685991] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686004] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686033] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686047] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686061] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686074] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686087] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686114] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686127] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686141] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686154] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686167] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686180] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686206] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686243] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686257] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686283] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686296] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686348] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686362] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686389] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:52.686418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:52.686431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:52.686446] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:52.686456] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:52.686468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:52.686480] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:52.686492] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:52.686504] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:52.686515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:52.686526] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:52.686539] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:52.689208] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=42] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585016999936, fast_delete_log_mode=false) [2025-04-21 14:08:52.690658] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=107] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:52.695016] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695022] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695083] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695157] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695626] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=45] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695678] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695904] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.695973] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.696019] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.696197] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.696704] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:52.696988] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:08:52.697046] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=50] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:52.697093] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:52.697138] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=15] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=4) [2025-04-21 14:08:52.697159] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] TxData Memory Statistic(logstream info): (ls_id={id:1001}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=16) [2025-04-21 14:08:52.697174] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=13] TxData Memory Statistic : (Tenant Total Memory(MB)=1024, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=20, Freeze TxData Trigger Memory(MB)=20, Total TxDataTable Hold Memory(MB)=26, Total TxDataTable Memory Limit(MB)=204) [2025-04-21 14:08:52.697965] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=70] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:52.698328] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=114] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215732698310], gts:1745215732697843000, latest_srr:[mts=1745215732698310]}) [2025-04-21 14:08:52.699842] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=16] Garbage Collector is running(seq_=13, gc_interval=10000000) [2025-04-21 14:08:52.699939] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=50] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:52.699990] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=35] gc_check_member_list_ cost time(ret=0, time_us=96) [2025-04-21 14:08:52.700035] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=35] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:08:52.702535] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=28] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:52.702598] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=53] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:52.702639] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=38] execute_gc cost time(ret=0, time_us=45) [2025-04-21 14:08:52.702671] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=27] ObSafeDestroyHandler start process [2025-04-21 14:08:52.702712] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=38] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:08:52.702747] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=21] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:08:52.709827] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=67] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:52.718491] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215732718485, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007639, add_bytes: 0 [2025-04-21 14:08:52.739390] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:52.754830] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.767980] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215732767435000, start_id=1745215732767435000, end_id=1745215732767435001) [2025-04-21 14:08:52.768608] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F007D-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.769903] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3962) [2025-04-21 14:08:52.769978] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1541, avg_log_submit_to_slide_time=1562) [2025-04-21 14:08:52.770172] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215732567779000, v:0}, new_max_version={val:1745215732567779000, v:0}, last_min_version={val:1745215732367383000, v:0}, last_max_version={val:1745215732367383000, v:0}, total_time_us=3861, delta_us=202390) [2025-04-21 14:08:52.770220] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215732567779000, v:0}, min_version={val:1745215732567779000, v:0}, max_version={val:1745215732567779000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:52.770750] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F007F-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.778032] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0082-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.778719] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0083-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:52.788591] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15999, max_lsn:26107466, max_scn:{val:1745215732672072000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26107466}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26106877}, last_submit_end_lsn:{lsn:26107466}, last_submit_log_id:15999, last_submit_log_pid:3, max_flushed_lsn:{lsn:26106877}, max_flushed_end_lsn:{lsn:26107466}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26107466}, last_slide_log_id:15999, last_slide_scn:{val:1745215732672072000, v:0}, last_slide_lsn:{lsn:26106877}, last_slide_end_lsn:{lsn:26107466}, last_slide_log_pid:3, last_slide_log_accum_checksum:3155344243, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16000, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26107466}, readable_log_tail:{lsn:26107466}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40997302, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:08:52.788849] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=250] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215732674996, last_flushed_end_lsn:{lsn:26107466}}]) [2025-04-21 14:08:52.788874] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16000, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215732674996, last_flushed_end_lsn:{lsn:26107466}}]) [2025-04-21 14:08:52.789153] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:52.805322] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=58] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:52.820641] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:08:52.826887] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=59] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:52.826936] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:08:52.826954] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:52.826981] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:52.827008] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254937377124, flush_io_finished_ret_:0, flush_io_finished_round_:124, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:52.831799] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:52.836143] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:52.853607] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=62] new mysql sessid created(conn.sessid_=3221487788, support_ssl=false) [2025-04-21 14:08:52.853706] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=89] new mysql sessid created(conn.sessid_=3221487789, support_ssl=false) [2025-04-21 14:08:52.853761] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=53] sm conn init succ(conn.sessid_=3221487788, sess.client_addr_="127.0.0.1:38028") [2025-04-21 14:08:52.853792] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=40] sm conn init succ(conn.sessid_=3221487789, sess.client_addr_="127.0.0.1:38038") [2025-04-21 14:08:52.853797] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=28] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487788, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:192}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.853824] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487789, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.853838] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487790, support_ssl=false) [2025-04-21 14:08:52.853919] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] sm conn init succ(conn.sessid_=3221487790, sess.client_addr_="127.0.0.1:38044") [2025-04-21 14:08:52.853955] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] accept one succ(*s={this:0x7f3bc7c04d70, session_id:3221487790, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.853997] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221487791, support_ssl=false) [2025-04-21 14:08:52.854038] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487791, sess.client_addr_="127.0.0.1:38058") [2025-04-21 14:08:52.854060] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3bc7c10030, session_id:3221487791, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.854332] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487792, support_ssl=false) [2025-04-21 14:08:52.854390] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221487792, sess.client_addr_="127.0.0.1:38102") [2025-04-21 14:08:52.854414] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3bc7c10d70, session_id:3221487792, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.854654] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487793, support_ssl=false) [2025-04-21 14:08:52.854714] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] sm conn init succ(conn.sessid_=3221487793, sess.client_addr_="127.0.0.1:38144") [2025-04-21 14:08:52.854741] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3bc7c12030, session_id:3221487793, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.854790] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=38] new mysql sessid created(conn.sessid_=3221487794, support_ssl=false) [2025-04-21 14:08:52.854864] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=31] sm conn init succ(conn.sessid_=3221487794, sess.client_addr_="127.0.0.1:38148") [2025-04-21 14:08:52.854891] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487794, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.854931] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] new mysql sessid created(conn.sessid_=3221487795, support_ssl=false) [2025-04-21 14:08:52.854920] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.854975] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] sm conn init succ(conn.sessid_=3221487795, sess.client_addr_="127.0.0.1:38162") [2025-04-21 14:08:52.854997] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487795, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.855017] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=39] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855072] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=33] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855073] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=24] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855096] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=23] mysql login queue(mysql_queue->queue_.size()=0) [2025-04-21 14:08:52.855115] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855150] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855178] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855179] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855216] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=26] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855216] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAC-0-0] [lt=51] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.855251] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855274] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855327] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB1-0-0] [lt=73] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.855366] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB0-0-0] [lt=44] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.855396] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855421] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855508] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855529] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855554] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.855581] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=20] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.855590] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=68] new mysql sessid created(conn.sessid_=3221487796, support_ssl=false) [2025-04-21 14:08:52.855653] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] sm conn init succ(conn.sessid_=3221487796, sess.client_addr_="127.0.0.1:38072") [2025-04-21 14:08:52.855679] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c12d70, session_id:3221487796, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.855717] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] new mysql sessid created(conn.sessid_=3221487797, support_ssl=false) [2025-04-21 14:08:52.855698] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E6-0-0] [lt=47] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215732855679}) [2025-04-21 14:08:52.855730] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFB-0-0] [lt=21] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.855756] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487797, sess.client_addr_="127.0.0.1:38084") [2025-04-21 14:08:52.855778] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3bc7c3c030, session_id:3221487797, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.855809] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] new mysql sessid created(conn.sessid_=3221487798, support_ssl=false) [2025-04-21 14:08:52.855844] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] sm conn init succ(conn.sessid_=3221487798, sess.client_addr_="127.0.0.1:38096") [2025-04-21 14:08:52.855863] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f3bc7c3cd70, session_id:3221487798, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.855893] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] new mysql sessid created(conn.sessid_=3221487799, support_ssl=false) [2025-04-21 14:08:52.855931] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] sm conn init succ(conn.sessid_=3221487799, sess.client_addr_="127.0.0.1:38112") [2025-04-21 14:08:52.855954] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3bc7c3e030, session_id:3221487799, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:227}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.855987] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487800, support_ssl=false) [2025-04-21 14:08:52.856022] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487800, sess.client_addr_="127.0.0.1:38128") [2025-04-21 14:08:52.856045] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3bc7c3ed70, session_id:3221487800, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.856122] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.856148] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.856174] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.856193] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=15] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.856171] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFB-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732856145, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.856219] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.856211] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFB-0-0] [lt=38] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215732855679}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732856145, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.856241] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.856263] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.856283] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=15] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.856259] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAC-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487788, proxy_sessid=0, client_sessid=3221487788, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.856308] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:08:52.856329] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:08:52.856336] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB1-0-0] [lt=35] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487795, proxy_sessid=0, client_sessid=3221487795, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.856345] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB0-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487794, proxy_sessid=0, client_sessid=3221487794, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.856397] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAD-0-0] [lt=43] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.856469] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB2-0-0] [lt=46] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.856484] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB1-0-0] [lt=55] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.856659] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E7-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215732856647}) [2025-04-21 14:08:52.856673] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFC-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.856745] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDBF-0-0] [lt=37] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215732856736}) [2025-04-21 14:08:52.856788] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDBF-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215732856786}) [2025-04-21 14:08:52.857242] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAD-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487793, proxy_sessid=0, client_sessid=3221487793, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.857246] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB2-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487792, proxy_sessid=0, client_sessid=3221487792, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.857280] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=38][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215732857274}) [2025-04-21 14:08:52.857317] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=35][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215732857274}) [2025-04-21 14:08:52.857340] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=22][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856196, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.857355] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB3-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.857364] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAE-0-0] [lt=43] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.857382] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=31][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215732857380}) [2025-04-21 14:08:52.857371] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB1-0-0] [lt=33] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487791, proxy_sessid=0, client_sessid=3221487791, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.857403] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=20][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215732857380}) [2025-04-21 14:08:52.857420] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=16][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856304, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.857493] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB2-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.858114] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAE-0-0] [lt=25] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487789, proxy_sessid=0, client_sessid=3221487789, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.858121] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB3-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487790, proxy_sessid=0, client_sessid=3221487790, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.858222] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAF-0-0] [lt=39] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.858225] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB4-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.858325] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB2-0-0] [lt=37] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487796, proxy_sessid=0, client_sessid=3221487796, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.858451] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB3-0-0] [lt=43] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.858543] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=23] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:52.858572] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFC-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858556, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.858577] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD96-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215732858571}) [2025-04-21 14:08:52.858607] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFC-0-0] [lt=34] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215732856647}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858556, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.858620] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620044][T1_L0_G0][T1001][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=31] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:52.858647] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620044][T1_L0_G0][T1002][YB420B1D7AB6-00063343B62EFDA2-0-0] [lt=15] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:52.858652] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFD-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:1745215732858644, is_mark_fail:false}]) [2025-04-21 14:08:52.858671] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFD-0-0] [lt=18] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215732856736}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:1745215732858644, is_mark_fail:false}]) [2025-04-21 14:08:52.858737] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFE-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:1745215732858723, is_mark_fail:false}]) [2025-04-21 14:08:52.858725] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487788, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.858773] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFE-0-0] [lt=34] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215732856786}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:1745215732858723, is_mark_fail:false}]) [2025-04-21 14:08:52.858808] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=68] kill and revert session(conn.sessid_=3221487788, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.858825] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFF-0-0] [lt=34] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.858855] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=45] sock ref clean, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487788, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.858923] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=48] unlock session of tenant(conn.sessid_=3221487788, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.858975] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=47] connection close(sessid=3221487788, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF00E7-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:25, seq_:31}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:32}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.859042] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB4-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487797, proxy_sessid=0, client_sessid=3221487797, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.859054] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDAF-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487798, proxy_sessid=0, client_sessid=3221487798, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.859108] INFO [SERVER] run (obmp_disconnect.cpp:82) [620062][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=41] free session successfully(sessid=3221487788) [2025-04-21 14:08:52.859146] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB5-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:08:52.859160] INFO [SERVER] run (obmp_disconnect.cpp:89) [620062][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=50] mark session id unused(sessid=3221487788) [2025-04-21 14:08:52.859285] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8E-0-0] [lt=40] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215732859272}) [2025-04-21 14:08:52.859371] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8E-0-0] [lt=62] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215732859366}) [2025-04-21 14:08:52.859393] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8D-0-0] [lt=28] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215732859386}) [2025-04-21 14:08:52.859434] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8E-0-0] [lt=50] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215732859430}) [2025-04-21 14:08:52.859477] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8E-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215732859475}) [2025-04-21 14:08:52.859516] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8E-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215732859514}) [2025-04-21 14:08:52.859632] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB3-0-0] [lt=33] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487799, proxy_sessid=0, client_sessid=3221487799, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.859929] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB5-0-0] [lt=28] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487800, proxy_sessid=0, client_sessid=3221487800, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:08:52.861871] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c04d70, session_id:3221487790, trace_id:YB420B1D7AB6-00063343B4AF00E9-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215732860961, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.861904] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=35][errcode=0] server close connection(sessid=3221487790, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.861946] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=38] quit [2025-04-21 14:08:52.861944] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63] kill and revert session(conn.sessid_=3221487790, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.861965] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=18][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:52.861984] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=17][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:52.862007] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=22][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:52.862028] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=19][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:52.862052] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=21][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.862075] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00E9-0-0] [lt=20][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.862093] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.862399] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC0-0-0] [lt=21][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215732862393}) [2025-04-21 14:08:52.862457] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC0-0-0] [lt=56][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215732862393}) [2025-04-21 14:08:52.862495] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC0-0-0] [lt=36][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717856999, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.862902] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA3-0-0] [lt=19] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215732862894}) [2025-04-21 14:08:52.862971] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EB-0-0] [lt=18] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215732862966}) [2025-04-21 14:08:52.863009] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD95-0-0] [lt=29][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215732863004}) [2025-04-21 14:08:52.863066] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD95-0-0] [lt=56][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215732863004}) [2025-04-21 14:08:52.863103] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD95-0-0] [lt=34][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215717865098, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.863569] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c3ed70, session_id:3221487800, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.863640] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=61] kill and revert session(conn.sessid_=3221487800, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.863709] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFF-0-0] [lt=34] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863682, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.863715] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=29] sock ref clean, do destroy(*s={this:0x7f3bc7c3ed70, session_id:3221487800, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.863757] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFDFF-0-0] [lt=46] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215732858571}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863682, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.863765] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=35] unlock session of tenant(conn.sessid_=3221487800, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.863813] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE00-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863804, sql_renew_time:1745215732863804, is_mark_fail:false}]) [2025-04-21 14:08:52.863791] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487800, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF00EA-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.863839] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE00-0-0] [lt=25] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215732859272}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863804, sql_renew_time:1745215732863804, is_mark_fail:false}]) [2025-04-21 14:08:52.863857] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=44] free session successfully(sessid=3221487800) [2025-04-21 14:08:52.863878] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE01-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863869, sql_renew_time:1745215732863869, is_mark_fail:false}]) [2025-04-21 14:08:52.863869] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=68][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c3cd70, session_id:3221487798, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.863893] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=35] mark session id unused(sessid=3221487800) [2025-04-21 14:08:52.863896] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE01-0-0] [lt=18] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215732859366}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863869, sql_renew_time:1745215732863869, is_mark_fail:false}]) [2025-04-21 14:08:52.863906] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] kill and revert session(conn.sessid_=3221487798, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.863898] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3bc7c04d70, session_id:3221487790, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215732860961, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:244, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:52.863923] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE02-0-0] [lt=19] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.863961] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=48] unlock session of tenant(conn.sessid_=3221487790, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.863990] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] sock ref clean, do destroy(*s={this:0x7f3bc7c3cd70, session_id:3221487798, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.863985] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487790, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF00E8-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:52.864038] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=46][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c12030, session_id:3221487793, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215732858826, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864041] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=33] unlock session of tenant(conn.sessid_=3221487798, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.864070] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] kill and revert session(conn.sessid_=3221487793, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.864064] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] connection close(sessid=3221487798, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA3-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.864105] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487790) [2025-04-21 14:08:52.864125] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=20] mark session id unused(sessid=3221487790) [2025-04-21 14:08:52.864142] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] sock ref clean, do destroy(*s={this:0x7f3bc7c12030, session_id:3221487793, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215732858826, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864134] INFO [SERVER] run (obmp_disconnect.cpp:82) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=43] free session successfully(sessid=3221487798) [2025-04-21 14:08:52.864176] INFO [SERVER] run (obmp_disconnect.cpp:89) [620048][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] mark session id unused(sessid=3221487798) [2025-04-21 14:08:52.864184] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] unlock session of tenant(conn.sessid_=3221487793, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.864199] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487793, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B64EFD90-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.864240] INFO [SERVER] run (obmp_disconnect.cpp:82) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=13] free session successfully(sessid=3221487793) [2025-04-21 14:08:52.864253] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487795, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864278] INFO [SERVER] run (obmp_disconnect.cpp:89) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487793) [2025-04-21 14:08:52.864303] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487795, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.864325] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] sock ref clean, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487795, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864365] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] unlock session of tenant(conn.sessid_=3221487795, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.864387] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487795, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA2-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.864441] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=48][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487794, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864445] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] free session successfully(sessid=3221487795) [2025-04-21 14:08:52.864469] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] mark session id unused(sessid=3221487795) [2025-04-21 14:08:52.864472] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] kill and revert session(conn.sessid_=3221487794, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.864524] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487794, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215732855619, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.864561] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] unlock session of tenant(conn.sessid_=3221487794, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.864581] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487794, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDBF-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.864634] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487794) [2025-04-21 14:08:52.864654] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=20] mark session id unused(sessid=3221487794) [2025-04-21 14:08:52.864654] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE02-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864641, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.864685] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE02-0-0] [lt=30] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215732859386}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864641, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.864727] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE03-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864719, sql_renew_time:1745215732864719, is_mark_fail:false}]) [2025-04-21 14:08:52.864752] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE03-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215732859430}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864719, sql_renew_time:1745215732864719, is_mark_fail:false}]) [2025-04-21 14:08:52.864787] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE04-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864780, sql_renew_time:1745215732864780, is_mark_fail:false}]) [2025-04-21 14:08:52.864810] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE04-0-0] [lt=22] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215732859475}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864780, sql_renew_time:1745215732864780, is_mark_fail:false}]) [2025-04-21 14:08:52.864845] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE05-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864838, sql_renew_time:1745215732864838, is_mark_fail:false}]) [2025-04-21 14:08:52.864868] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE05-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215732859514}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864838, sql_renew_time:1745215732864838, is_mark_fail:false}]) [2025-04-21 14:08:52.864896] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE06-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.865269] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE06-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732865259, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.865302] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE06-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215732862894}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732865259, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.865338] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE07-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:52.865596] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE07-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732865587, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.865623] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE07-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215732862966}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732865587, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:52.866189] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620062][T1_L0_G0][T1][YB420B1D7AB6-00063343B87EFD8D-0-0] [lt=42][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:52.866551] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD96-0-0] [lt=47][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:52.866571] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c10d70, session_id:3221487792, trace_id:YB420B1D7AB6-00063343B62EFDA4-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215732866322, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.866613] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=36] kill and revert session(conn.sessid_=3221487792, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.866856] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=53][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c12d70, session_id:3221487796, trace_id:YB420B1D7AB6-00063343B4AF00EC-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215732866322, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.866886] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=37][errcode=0] server close connection(sessid=3221487796, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.866913] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=50] kill and revert session(conn.sessid_=3221487796, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.866920] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=30] quit [2025-04-21 14:08:52.866941] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=20][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:52.866964] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=21][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:52.866983] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:52.867002] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:52.867023] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867042] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EC-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867061] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.866592] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=25][errcode=0] server close connection(sessid=3221487792, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.867341] INFO [SERVER] process (obmp_quit.h:56) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=742] quit [2025-04-21 14:08:52.867381] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=37][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:52.867409] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=26][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:52.867427] WDIAG [SERVER] response (obmp_base.cpp:87) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:52.867447] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:52.867447] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=17][errcode=0] server close connection(sessid=3221487789, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.867430] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487789, trace_id:YB420B1D7AB6-00063343B4AF00ED-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215732867388, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.867469] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=21] quit [2025-04-21 14:08:52.867468] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867480] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=42] kill and revert session(conn.sessid_=3221487789, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.867488] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=18][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:52.867488] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA4-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867507] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867505] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=16][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:52.867595] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=89][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:52.867608] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=12][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:52.867627] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867644] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00ED-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.867661] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.868224] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] can close safely, do destroy(*s={this:0x7f3bc7c12d70, session_id:3221487796, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:223}, err:5, last_decode_time:1745215732866322, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:52.868277] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=41] unlock session of tenant(conn.sessid_=3221487796, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.868296] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] connection close(sessid=3221487796, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF00EB-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:52.868344] INFO [SERVER] run (obmp_disconnect.cpp:82) [620052][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] free session successfully(sessid=3221487796) [2025-04-21 14:08:52.868356] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=53][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c3c030, session_id:3221487797, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.868381] INFO [SERVER] run (obmp_disconnect.cpp:89) [620052][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36] mark session id unused(sessid=3221487796) [2025-04-21 14:08:52.868390] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=29] kill and revert session(conn.sessid_=3221487797, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.868457] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f3bc7c3c030, session_id:3221487797, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.868507] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487797, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.868530] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487797, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD95-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.868576] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487797) [2025-04-21 14:08:52.868598] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487797) [2025-04-21 14:08:52.871385] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC0-0-0] [lt=52][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:08:52.871814] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=54][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c3e030, session_id:3221487799, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.871859] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=39] kill and revert session(conn.sessid_=3221487799, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.871878] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f3bc7c3e030, session_id:3221487799, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215732862036, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.871915] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] unlock session of tenant(conn.sessid_=3221487799, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.871932] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] connection close(sessid=3221487799, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDC0-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:08:52.871968] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=33] free session successfully(sessid=3221487799) [2025-04-21 14:08:52.871991] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487799) [2025-04-21 14:08:52.872944] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:52.873025] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.874400] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=53] BlockGCTimerTask success(ret=0, cost_time_us=29, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:1, flying_meta_task:0}}) [2025-04-21 14:08:52.880210] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE40-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:52.880282] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE40-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:52.888657] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=37] LogLoopThread round_cost_time(us)(round_cost_time=351) [2025-04-21 14:08:52.891244] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:52.901435] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] can close safely, do destroy(*s={this:0x7f3bc7c10d70, session_id:3221487792, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:219}, err:5, last_decode_time:1745215732866322, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:52.901527] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=72] unlock session of tenant(conn.sessid_=3221487792, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:52.901550] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487792, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B87EFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:52.901683] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487792) [2025-04-21 14:08:52.901707] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c10030, session_id:3221487791, trace_id:YB420B1D7AB6-00063343B5BEFDC1-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215732900757, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:08:52.901707] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=35][errcode=0] server close connection(sessid=3221487791, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:52.901735] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=51] mark session id unused(sessid=3221487792) [2025-04-21 14:08:52.901750] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] kill and revert session(conn.sessid_=3221487791, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:08:52.901754] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=43] quit [2025-04-21 14:08:52.901782] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=26][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:08:52.901810] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=26][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:08:52.901827] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=16][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:08:52.901852] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=22][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:08:52.901878] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=21][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.901898] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC1-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.901916] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:08:52.939551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:52.952832] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:52.952900] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:52.955004] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:52.957776] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=33] current monitor number(seq_=-1) [2025-04-21 14:08:53.014712] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:53.014761] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=49] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:53.014764] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBA-0-0] [lt=24] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:53.014831] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBA-0-0] [lt=60] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:53.030877] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=51] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:08:53.035427] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:53.036292] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFBB-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:53.038244] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:53.055090] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.074596] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:53.074679] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.091872] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:53.114023] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3962) [2025-04-21 14:08:53.139705] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:53.143113] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65767564}], scn_array=[cnt:1, {val:1745215732967610001, v:0}], curr_size=122, accum_size=2558, time_cost=28952) [2025-04-21 14:08:53.144226] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] can close safely, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487789, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:205}, err:5, last_decode_time:1745215732867388, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:798, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:53.144310] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=66] unlock session of tenant(conn.sessid_=3221487789, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:53.144357] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=44] connection close(sessid=3221487789, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD96-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:53.144434] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487789) [2025-04-21 14:08:53.144472] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36] mark session id unused(sessid=3221487789) [2025-04-21 14:08:53.146630] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EE-0-0] [lt=16][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.149214] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00EE-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254938699521, cache_obj->added_lc()=false, cache_obj->get_object_id()=682, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:53.155175] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.198610] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=36] ts response task statistics(alloc_count=2742, free_count=1370) [2025-04-21 14:08:53.246474] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF6-0-0] [lt=27] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:53.246536] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF6-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:53.246996] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC1-0-0] [lt=44] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:53.247090] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC1-0-0] [lt=81] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=99) [2025-04-21 14:08:53.255264] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.273293] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] get number(ret=0, service_type_=0, range=1, base_id=1745215733272806000, start_id=1745215733272806000, end_id=1745215733272806001) [2025-04-21 14:08:53.280937] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:53.292471] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:53.298177] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE44-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:53.298249] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE44-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:53.309608] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=16kB/s, net_out=16kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:53.309730] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=81] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:53.309982] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:53.310226] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:53.310341] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:20, schedule:45, submit:10, rt:1269, total:1345) [2025-04-21 14:08:53.310442] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:53.310543] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=90] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:20, schedule:45, submit:10, device:1269, total:1345) [2025-04-21 14:08:53.310615] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:53.310742] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:629, total:642) [2025-04-21 14:08:53.310852] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:53.310916] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:629, total:642) [2025-04-21 14:08:53.310993] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:53.311033] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:53.339878] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:53.355354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.368872] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3972, avg_group_log_size=397) [2025-04-21 14:08:53.373094] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:53.373142] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.390393] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:53.390480] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:53.390514] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:53.390553] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:53.390587] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:53.392132] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1799, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:53.392179] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:53.392225] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:53.392200] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1771, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:53.392254] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:53.392262] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:53.392354] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:53.392386] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2077, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:53.392375] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=24] [APPLY STAT CB APPEND COST TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=30, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:53.392402] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=2047, avg_log_submit_to_slide_time=2067) [2025-04-21 14:08:53.392417] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=40] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1495, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:53.392441] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:53.392446] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=28] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:53.392468] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=21] [APPLY STAT CB EXECUTE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=-469, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:53.392477] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:53.392489] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1056, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:53.392507] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:53.392527] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2094, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:53.392545] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=2039, avg_log_submit_to_slide_time=2059) [2025-04-21 14:08:53.392539] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:53.392572] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:53.392581] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:53.420534] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=51] gc stale ls task succ [2025-04-21 14:08:53.421948] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:53.424375] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1593, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:53.424458] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:53.424634] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=16, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:53.424691] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1753, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:53.424709] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1695, avg_log_submit_to_slide_time=1723) [2025-04-21 14:08:53.424756] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=70, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:53.424786] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8260, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:53.431137] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:53.431246] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=81] temporary file module use no blocks [2025-04-21 14:08:53.431285] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=31] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:53.431356] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=61] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:53.431402] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254937981323, flush_io_finished_ret_:0, flush_io_finished_round_:125, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:53.431869] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:53.437086] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8260, avg_group_log_size=516) [2025-04-21 14:08:53.437136] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8260) [2025-04-21 14:08:53.443064] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8260) [2025-04-21 14:08:53.443181] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8260) [2025-04-21 14:08:53.453081] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:53.453149] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.455440] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.475293] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.475386] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.475498] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=55] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.475663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.493070] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:53.502403] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=600000, clean_num=200000) [2025-04-21 14:08:53.514283] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=87] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:53.514352] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:53.516154] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=102] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4388, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:53.516202] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3972) [2025-04-21 14:08:53.516241] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:53.516315] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:53.516378] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4575, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:53.516417] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=72, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:53.516467] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3972, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:53.547068] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=89] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6100000, replace_num=100000) [2025-04-21 14:08:53.547138] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:53.555537] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.564890] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=23] ====== traversal_flush timer task ====== [2025-04-21 14:08:53.565073] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9E-0-0] [lt=50] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215733198588001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215730195314002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:53.565254] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9E-0-0] [lt=141] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215730195314002, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:53.565330] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9E-0-0] [lt=73] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:53.574943] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=2079744) [2025-04-21 14:08:53.575014] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.577019] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:53.582089] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:53.582146] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:08:53.582165] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:53.582191] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:53.582216] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254938132328, flush_io_finished_ret_:0, flush_io_finished_round_:125, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:53.589637] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4035, offset=66933}, end_cursor:ObLogCursor{file_id=3, log_id=4036, offset=67239}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774d8050, len:2699, log_data_len:306, seq:4035, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:53.590148] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5A-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:53.590250] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5A-0-0] [lt=64] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215733198588002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215733198588002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:53.590657] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:53.590760] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:53.590803] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:53.591963] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:53.593739] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:53.594521] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE5A-0-0] [lt=21] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215732197021002, v:0}, new_replayable_scn={val:1745215732197021002, v:0}, new_readable_scn={val:1745215732197021002, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215731196383001, replayable_scn:1745215731196383001, readable_scn:1745215731196383001, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:08:53.594615] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC4-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:53.595518] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0085-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.595598] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] can close safely, do destroy(*s={this:0x7f3bc7c10030, session_id:3221487791, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:218}, err:5, last_decode_time:1745215732900757, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:229, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:08:53.595714] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=95] unlock session of tenant(conn.sessid_=3221487791, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:08:53.595752] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] connection close(sessid=3221487791, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:08:53.595826] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDBF-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.595862] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0086-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.596061] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=42] free session successfully(sessid=3221487791) [2025-04-21 14:08:53.596095] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=33] mark session id unused(sessid=3221487791) [2025-04-21 14:08:53.598135] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0089-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.598224] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC1-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.599092] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F008A-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.599588] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=73] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4036, offset=67239}, end_cursor:ObLogCursor{file_id=3, log_id=4037, offset=67536}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774dc050, len:2393, log_data_len:297, seq:4036, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:53.599951] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5A-0-0] [lt=47] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:53.600031] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5A-0-0] [lt=62] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215733198588002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215733198588002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:53.604489] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:53.604537] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:53.606334] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:53.606373] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:53.616244] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F0-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.618805] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F0-0-0] [lt=62][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254939169112, cache_obj->added_lc()=false, cache_obj->get_object_id()=683, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:53.646262] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:53.647951] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=74] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:53.648054] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=100] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:53.648169] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=67] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215731196383001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:53.648340] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=164] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:53.648391] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:53.648433] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=37] get rec log scn(service_type_=0, rec_log_ts={val:1745215724188868002, v:0}) [2025-04-21 14:08:53.648463] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:53.648500] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:53.648577] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:53.648618] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:53.648669] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:53.648721] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=49] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:53.650346] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=29] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:53.650420] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=73] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:53.650439] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1745215733650435, bytes: 4684442, bw: 0.016261 MB/s, add_ts: 1007618, add_bytes: 17181 [2025-04-21 14:08:53.650496] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215731196383001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:53.650623] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=123] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:53.650660] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:53.650704] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:53.650744] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:53.650779] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:53.650816] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:53.650860] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=43] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:53.650890] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:53.655624] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.678452] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=42] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:53.695186] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695309] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695634] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695671] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695714] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695804] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695862] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.695910] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.696146] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=51] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.696306] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.696790] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:53.699245] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=98] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:53.699363] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=95] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215733699340], gts:1745215733698951000, latest_srr:[mts=1745215733699340]}) [2025-04-21 14:08:53.703016] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:53.706273] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:53.707563] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=53] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:53.707664] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215728763799000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:53.726091] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1745215733726086, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007601, add_bytes: 0 [2025-04-21 14:08:53.747261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:53.755693] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.762849] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA0-0-0] [lt=47] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:53.772059] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:08:53.772084] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F008C-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.772141] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=34, avg_log_submit_to_flush_time=4691, avg_log_submit_to_slide_time=4723) [2025-04-21 14:08:53.772339] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215733568907000, v:0}, new_max_version={val:1745215733568907000, v:0}, last_min_version={val:1745215733368638000, v:0}, last_max_version={val:1745215733368638000, v:0}, total_time_us=5136, delta_us=203428) [2025-04-21 14:08:53.772393] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215733568907000, v:0}, min_version={val:1745215733568907000, v:0}, max_version={val:1745215733568907000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:53.774965] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F008E-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.785744] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0091-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.786632] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0092-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:53.789261] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:53.790738] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:53.790783] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] try gc retain ctx [2025-04-21 14:08:53.790798] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:53.790853] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215733198588004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215723687543000, v:0}, keep_alive_scn_:{val:1745215728693381000, v:0}, update_ts_:1745215733790497}) [2025-04-21 14:08:53.791777] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215731196383001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215740473222000, latest_log_ts:{val:1745215724188868002, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:53.792030] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=141] finish update min start scn(max_decided_scn={val:1745215733198588004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215723687543000, v:0}, keep_alive_scn_:{val:1745215728693381000, v:0}, update_ts_:1745215733791564}) [2025-04-21 14:08:53.792992] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215731196383001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:53.793955] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=19] [APPLY STAT CB APPEND COST TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:53.794042] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=86] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=1714, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:53.794060] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:53.794082] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=-669, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:53.794104] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=20] [APPLY STAT CB TOTAL TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=1107, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:53.813363] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:08:53.813477] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=97] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:53.820716] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:53.827146] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:53.827210] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:08:53.827237] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:53.827401] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=158] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:53.827436] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=33] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254938377367, flush_io_finished_ret_:0, flush_io_finished_round_:125, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:53.831984] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:53.837388] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:53.845348] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=61] ====== tenant freeze timer task ====== [2025-04-21 14:08:53.855763] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.873241] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:53.873307] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.881671] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE41-0-0] [lt=20] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:53.881736] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE41-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:53.903572] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43609407488, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:53.904091] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:53.905915] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] get number(ret=0, service_type_=0, range=1, base_id=1745215733905839000, start_id=1745215733905839000, end_id=1745215733905839001) [2025-04-21 14:08:53.924289] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=55] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:53.947409] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:53.953295] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:53.953359] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:53.955834] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:53.957935] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=46] current monitor number(seq_=-1) [2025-04-21 14:08:53.962443] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=97] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:53.971701] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215733198588004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=773100, in_cluster_service=true, cluster_version={val:1745215733198588003, v:0}, min_cluster_version={val:1745215733198588003, v:0}, max_cluster_version={val:1745215733198588003, v:0}, get_cluster_version_err=0, cluster_version_delta=773100, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1110, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=64847424, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:54.035573] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=49] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:54.037109] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFC0-0-0] [lt=53] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:54.055916] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.067450] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=30] get_max_applied_scn(scn={val:1745215733968267000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65771099}, palf_committed_end_scn_:{val:1745215733968267000, v:0}, last_check_scn_:{val:1745215733968267000, v:0}, max_applied_cb_scn_:{val:1745215733968267000, v:0}}) [2025-04-21 14:08:54.067527] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=66] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65771099}, readable_log_tail:{lsn:65771099}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1333669, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:54.068735] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:08:54.068804] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=63] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:08:54.068825] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:08:54.068848] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:54.072006] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:08:54.072359] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=349] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:54.075139] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:54.075195] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.104336] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=89] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43609407488, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:54.114820] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:08:54.147587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:54.154820] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F2-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.156006] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.157537] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F2-0-0] [lt=54][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254939707843, cache_obj->added_lc()=false, cache_obj->get_object_id()=684, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:54.185929] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65771221}], scn_array=[cnt:1, {val:1745215734169019000, v:0}], curr_size=584, accum_size=2705, time_cost=16403) [2025-04-21 14:08:54.199998] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=80] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215734199959], gts:1745215734199179000, latest_srr:[mts=1745215734199959]}) [2025-04-21 14:08:54.200336] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=73] submit log success(service_type_=0, last_id=1745215750473222000, limited_id=1745215750473222000) [2025-04-21 14:08:54.200372] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=35] submit log with lock success(service_type_=0, last_id=1745215750473222000, limited_id=1745215750473222000) [2025-04-21 14:08:54.200402] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=14] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=418, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:54.202032] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=26] update id meta(ret=0, service_type=0, limited_id=1745215750473222000, latest_scn={val:1745215734200261001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215731196383001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:54.202157] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=123] handle submit callback(service_type_=0, success=true, used_ts=1822, log_ts={val:1745215734200261001, v:0}, limited_id=1745215750473222000) [2025-04-21 14:08:54.202186] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=24] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:54.202226] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F006D-0-0] [lt=37] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:54.224172] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=38] [APPLY STAT CB APPEND COST TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:54.224244] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=71] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=1707, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:54.224261] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:54.224283] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=-458, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:54.224303] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=1306, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:54.239086] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:54.239167] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] get_max_applied_scn(scn={val:1745215734073495000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26119584}, palf_committed_end_scn_:{val:1745215734236701000, v:0}, last_check_scn_:{val:1745215734236701000, v:0}, max_applied_cb_scn_:{val:1745215734073495000, v:0}}) [2025-04-21 14:08:54.239216] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26119584}, readable_log_tail:{lsn:26119584}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40985184, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:54.248556] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF7-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:54.248612] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF7-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:54.256075] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.275576] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=77] get_max_applied_scn(scn={val:1745215733698951003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17350176}, palf_committed_end_scn_:{val:1745215734200261001, v:0}, last_check_scn_:{val:1745215734200261001, v:0}, max_applied_cb_scn_:{val:1745215733698951003, v:0}}) [2025-04-21 14:08:54.275646] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=60] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17350176}, readable_log_tail:{lsn:17350176}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49754592, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:54.287236] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=46] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:54.299865] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE45-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:54.299931] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE45-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:54.304864] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=99] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:54.309447] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=51][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:54.312203] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:54.312262] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:54.312445] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:54.312624] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:54.312706] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8172, [delay/us]:prepare:20, schedule:134, submit:10, rt:1593, total:1758) [2025-04-21 14:08:54.312779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:54.312837] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:20, schedule:134, submit:10, device:1593, total:1758) [2025-04-21 14:08:54.312895] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:54.312966] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1134, total:1151) [2025-04-21 14:08:54.313061] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:54.313104] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1134, total:1151) [2025-04-21 14:08:54.313163] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:54.313188] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:54.347771] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:54.356162] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.372032] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=102] get_max_applied_scn(scn={val:1745215733698951004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8767710}, palf_committed_end_scn_:{val:1745215734200261000, v:0}, last_check_scn_:{val:1745215734200261000, v:0}, max_applied_cb_scn_:{val:1745215733698951004, v:0}}) [2025-04-21 14:08:54.372081] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8767710}, readable_log_tail:{lsn:8767710}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58337058, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:54.373411] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:54.373463] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.390204] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=48] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:54.391196] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:54.391243] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:08:54.391276] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:54.391307] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:54.391336] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:54.392580] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1599, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:54.392630] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:54.392670] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1502, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:54.392706] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:54.392748] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1749, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:54.392752] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:54.392784] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:54.392798] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:54.392832] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:54.392854] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1630, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:54.392882] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:54.399841] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:54.399896] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:54.399888] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:08:54.399924] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=25] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=26) [2025-04-21 14:08:54.400022] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9F-0-0] [lt=36] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215734273228000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:54.400183] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFD9F-0-0] [lt=154] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:54.403516] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:08:54.403556] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=34] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:54.420585] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=158] gc stale ls task succ [2025-04-21 14:08:54.422706] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=76] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:54.423956] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=53] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:54.431582] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=84] temporary file module use no blocks [2025-04-21 14:08:54.431638] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=53] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:54.431670] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:54.431708] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=36] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254938981803, flush_io_finished_ret_:0, flush_io_finished_round_:126, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:54.432075] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=60] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:54.436817] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:08:54.437688] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=100] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8809, avg_group_log_size=518) [2025-04-21 14:08:54.437738] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8809) [2025-04-21 14:08:54.437769] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:1, active_tx_count:1, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:54.437826] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=54] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:54.437896] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=36] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:54.437989] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=89] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:54.438029] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:54.438055] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215731434521001, v:0}) [2025-04-21 14:08:54.438073] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:54.438090] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:54.438110] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:54.438139] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:54.438160] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:54.438189] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:54.438218] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:54.438238] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:54.438977] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=2344, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:54.439023] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:54.439057] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:54.439094] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=2522, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:54.439114] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=2471, avg_log_submit_to_slide_time=2496) [2025-04-21 14:08:54.439148] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:54.439168] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9398, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:54.453500] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:54.453558] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.456246] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.474679] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=65] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.474764] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.475204] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.475541] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.476205] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9398) [2025-04-21 14:08:54.476283] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9398) [2025-04-21 14:08:54.486411] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:54.486528] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=44][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:54.488121] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215734486576) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215734486576) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:54.492683] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1339) [2025-04-21 14:08:54.492762] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1671, avg_log_submit_to_slide_time=1697) [2025-04-21 14:08:54.492812] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:08:54.492834] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1598, avg_log_submit_to_slide_time=1611) [2025-04-21 14:08:54.492844] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1339, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:54.492898] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:54.499332] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:08:54.505408] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:54.508663] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=45] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:54.515078] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=80] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:54.515135] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3656, avg_group_log_size=332) [2025-04-21 14:08:54.515173] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:54.516903] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=87] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3242, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:54.516947] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:08:54.516980] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:54.517067] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:54.517117] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3430, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:54.517142] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:54.517183] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:54.547921] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:54.556335] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.569078] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:08:54.569136] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=51] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:54.575347] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=2079744) [2025-04-21 14:08:54.575402] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.577073] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:08:54.582354] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:54.582410] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:54.582429] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:54.582458] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:54.582486] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254939132577, flush_io_finished_ret_:0, flush_io_finished_round_:126, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:54.591363] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:08:54.591432] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:54.591467] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:54.592672] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:08:54.593917] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:54.599589] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0094-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.599610] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC2-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.599959] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFD9E-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.602482] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC4-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.602499] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0095-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.603195] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0096-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.604096] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:54.604139] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:54.605442] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:54.605480] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:54.606399] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4037, offset=67536}, end_cursor:ObLogCursor{file_id=3, log_id=4038, offset=67842}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774e0050, len:2096, log_data_len:306, seq:4037, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:54.606712] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5B-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:54.606778] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5B-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215734200261003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215734200261003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:54.611896] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=141] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:08:54.612852] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4038, offset=67842}, end_cursor:ObLogCursor{file_id=3, log_id=4039, offset=68139}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774e4050, len:1790, log_data_len:297, seq:4038, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:54.613110] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5B-0-0] [lt=48] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:54.613167] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5B-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215734200261002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215734200261002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:54.620940] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=59] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:54.622846] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:54.622888] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] try gc retain ctx [2025-04-21 14:08:54.622903] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:54.622951] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215734474370000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215724477445001, v:0}, keep_alive_scn_:{val:1745215729542453001, v:0}, update_ts_:1745215734622533}) [2025-04-21 14:08:54.623923] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:54.626149] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:54.653054] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=29] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:54.653111] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=24) [2025-04-21 14:08:54.654201] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:54.654251] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:54.654278] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=24] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:54.654298] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=24) [2025-04-21 14:08:54.656417] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.658104] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1745215734658099, bytes: 4696650, bw: 0.011554 MB/s, add_ts: 1007664, add_bytes: 12208 [2025-04-21 14:08:54.688940] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:54.688996] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=42] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=26) [2025-04-21 14:08:54.692339] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:54.692386] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:54.692412] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=23] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=26) [2025-04-21 14:08:54.695098] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=86] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695135] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:54.695225] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=32][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:08:54.695370] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695412] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=58] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695711] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695731] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695757] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695794] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695837] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.695872] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=64] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.696260] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=64] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.696401] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:54.698725] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2025-04-21 14:08:54.698768] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=34] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62735140, tenant_id=1002) [2025-04-21 14:08:54.698817] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:54.700656] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:54.700704] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=401, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:54.705360] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDED-0-0] [lt=35] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:54.705900] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43607310336, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:54.733706] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215734733698, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2025-04-21 14:08:54.741855] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDEB-0-0] [lt=57] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:54.748075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:54.756562] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:54.756593] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:54.756622] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.774211] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:08:54.774295] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=3269, avg_log_submit_to_slide_time=3295) [2025-04-21 14:08:54.774620] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=111] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215734569238000, v:0}, new_max_version={val:1745215734569238000, v:0}, last_min_version={val:1745215734368552000, v:0}, last_max_version={val:1745215734368552000, v:0}, total_time_us=6665, delta_us=205379) [2025-04-21 14:08:54.774707] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=83] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215734569238000, v:0}, min_version={val:1745215734569238000, v:0}, max_version={val:1745215734569238000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:54.777303] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0098-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.780995] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F009A-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.789564] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:54.792004] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F009D-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.792951] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F009E-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:54.820788] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:54.832136] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:54.838071] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:54.856565] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.873564] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:54.873628] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.883240] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE42-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:54.883305] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE42-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:54.901485] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:54.901557] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=65] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:54.901578] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:54.901600] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:54.904931] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=22] Dumping All Cache Objs(alloc_obj_list.count()=328, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}]) [2025-04-21 14:08:54.905658] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=722] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:54.906385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:54.906571] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD6-0-0] [lt=40] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215734906548}) [2025-04-21 14:08:54.906639] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD6-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215734906633}) [2025-04-21 14:08:54.906641] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE08-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215734906609, sql_renew_time:1745215734906609, is_mark_fail:false}]) [2025-04-21 14:08:54.906723] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE08-0-0] [lt=81] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215734906548}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215734906609, sql_renew_time:1745215734906609, is_mark_fail:false}]) [2025-04-21 14:08:54.906765] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE09-0-0] [lt=31] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:54.907212] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE09-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215734907199, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:54.907244] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE09-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215734906633}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215734907199, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:54.908297] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD6-0-0] [lt=23] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:54.913625] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] start to print blacklist info [2025-04-21 14:08:54.913781] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=31] ls blacklist refresh finish(cost_time=8553) [2025-04-21 14:08:54.915905] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=54] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:54.931196] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDEF-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:54.931286] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDF1-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:54.948238] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:54.953742] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:54.953801] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:54.956635] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:54.958018] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=42] current monitor number(seq_=-1) [2025-04-21 14:08:54.980037] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=48] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:55.015541] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:55.015596] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=53] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:55.015589] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBB-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:55.015635] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBB-0-0] [lt=42] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:55.035727] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=63] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:55.037764] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFC5-0-0] [lt=51] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:55.053478] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=34] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:55.053583] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=63] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:55.053610] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=204, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:55.053686] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:55.053760] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:55.053798] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=26, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:55.056707] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.059383] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=72] LogLoopThread round_cost_time(us)(round_cost_time=18) [2025-04-21 14:08:55.075571] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:55.075661] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=82] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.106892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:55.115504] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:08:55.148433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=103] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:55.156771] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.160968] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F3-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.163488] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F3-0-0] [lt=73][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254940713794, cache_obj->added_lc()=false, cache_obj->get_object_id()=685, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:55.212470] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=45] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1, avail_memory=268435456, chunk_count_=0, avail_sort_memory_=268435456, avail_memory_=268435456) [2025-04-21 14:08:55.212563] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=58] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:08:55.212618] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=50] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:08:55.236282] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215735036997000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199276, in_cluster_service=true, cluster_version={val:1745215734837288000, v:0}, min_cluster_version={val:1745215734837288000, v:0}, max_cluster_version={val:1745215734837288000, v:0}, get_cluster_version_err=0, cluster_version_delta=398985, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1121, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=70056866, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:55.247859] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC2-0-0] [lt=66] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:55.247908] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC2-0-0] [lt=42] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=61) [2025-04-21 14:08:55.250555] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF8-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:55.250614] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF8-0-0] [lt=57] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:55.256830] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDCC-0-0] [lt=45] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.256844] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.259700] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=39] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:55.259821] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=120] check all tenants(ret=0) [2025-04-21 14:08:55.261140] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDCF-0-0] [lt=17] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.262436] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD0-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.263790] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD1-0-0] [lt=51] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.265101] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD2-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.266406] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD3-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.267751] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD4-0-0] [lt=31] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.269059] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD5-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.289685] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=101] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:55.301826] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE46-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:55.301916] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE46-0-0] [lt=86] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.307368] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:55.314301] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:55.314389] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:55.314579] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:55.314785] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:55.314877] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:35, submit:9, rt:1286, total:1347) [2025-04-21 14:08:55.314954] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:55.315025] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:17, schedule:35, submit:9, device:1286, total:1347) [2025-04-21 14:08:55.315087] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:55.315162] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:676, total:690) [2025-04-21 14:08:55.315241] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:55.315278] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:676, total:690) [2025-04-21 14:08:55.315341] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:55.315370] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:55.348612] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:55.354053] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [620256][T1002_FreInfoRe][T1001][YB420B1D7AB6-00063343B04EFE48-0-0] [lt=44] need check schema(new_schema_version=1745215649759944, cached_tenant_schema_version=1745215649759944, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT * FROM __all_merge_info WHERE tenant_id = ?) [2025-04-21 14:08:55.356915] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.358342] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=54] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:55.359622] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:55.359725] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215731182505000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:55.367724] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=56] success to update min reserved snapshot(reserved_snapshot=1745213928763799000, duration=1800, snapshot_gc_ts=1745215728763799000) [2025-04-21 14:08:55.368381] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] success to update min reserved snapshot(reserved_snapshot=1745213925571082000, duration=1800, snapshot_gc_ts=1745215725571082000) [2025-04-21 14:08:55.369565] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=53] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213928763799000) [2025-04-21 14:08:55.369614] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=46] update reserved snapshot finished(cost_ts=1897, reserved_snapshot=1745213928763799000) [2025-04-21 14:08:55.369638] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] update reserved snapshot finished(cost_ts=1261, reserved_snapshot=1745213925571082000) [2025-04-21 14:08:55.371458] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65779670, this={dio_aligned_buf:{buf_write_offset:2591, buf_padding_size:1505, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3448, truncate_used_ts:1388}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65777664, buf_len=585, total_write_size=39388, total_write_size_after_dio=471040, ob_pwrite_used_ts=202494, count=106, each_pwrite_cost=1910) [2025-04-21 14:08:55.372317] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:08:55.373809] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215735373417000, start_id=1745215735373417000, end_id=1745215735373417001) [2025-04-21 14:08:55.373774] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:55.373860] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.391931] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:55.391990] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:55.392018] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:55.392053] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:55.392084] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:55.393594] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1480, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:55.393635] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:55.393665] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:55.393670] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1556, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:55.393702] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:55.393729] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:55.393765] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1621, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:55.393789] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:55.393825] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:55.393840] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1720, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:55.393861] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:55.420656] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=32] gc stale ls task succ [2025-04-21 14:08:55.423453] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=90] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:55.431864] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=51] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:55.432231] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:55.438263] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8486, avg_group_log_size=471) [2025-04-21 14:08:55.438302] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8487) [2025-04-21 14:08:55.439676] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1508, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:55.439768] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=74] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:55.439802] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:55.439844] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1635, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:55.439864] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=1595, avg_log_submit_to_slide_time=1617) [2025-04-21 14:08:55.439899] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:55.439948] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8486, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:55.440051] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:55.453967] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:55.454044] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.456983] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.475078] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.475269] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.475449] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.475508] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.476437] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8486) [2025-04-21 14:08:55.476534] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8486) [2025-04-21 14:08:55.493491] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:55.493556] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1683, avg_log_submit_to_slide_time=1699) [2025-04-21 14:08:55.493601] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:55.493624] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1602, avg_log_submit_to_slide_time=1616) [2025-04-21 14:08:55.493647] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:55.493738] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:55.507887] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:55.515914] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:55.515970] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4192, avg_group_log_size=349) [2025-04-21 14:08:55.516006] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:55.517257] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=800000, clean_num=200000) [2025-04-21 14:08:55.517492] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=85] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1546, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:55.517527] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4192) [2025-04-21 14:08:55.517560] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:55.517606] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:55.517643] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1684, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:55.517673] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:55.517713] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4192, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:55.536561] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get wrs ts(ls_id={id:1}, delta=99048, log_service_ts=1745215735437492, min_tx_service_ts=4611686018427387, timestamp={val:1745215735437492000, v:0}) [2025-04-21 14:08:55.536610] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=58, Other_Error_Cnt=0, Submit_Succ_Cnt=42, last_scn="{val:1745215734614971001, v:0}", last_lsn={lsn:26123414}, last_gts={val:1745215735473879000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:08:55.548780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:55.557028] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.575790] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:55.575869] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.577154] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:55.582624] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:55.582678] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:55.582711] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=30] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:55.582738] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:55.582761] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254940132848, flush_io_finished_ret_:0, flush_io_finished_round_:127, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:55.590713] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=28] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:55.591970] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=57] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:55.592087] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:55.592078] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215735579281000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:55.592160] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:55.592193] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:55.593629] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:55.594036] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:55.600540] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC5-0-0] [lt=47] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:55.603976] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC5-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.603990] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:55.604026] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:55.604271] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00A0-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.604329] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC6-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.605771] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:55.605810] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:55.607114] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00A3-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.607154] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC8-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.607337] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00A4-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.619335] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4039, offset=68139}, end_cursor:ObLogCursor{file_id=3, log_id=4040, offset=68445}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774e8050, len:1493, log_data_len:306, seq:4039, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:55.619655] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5C-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:55.619729] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5C-0-0] [lt=47] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215735200533002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215735200533002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:55.623376] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE5C-0-0] [lt=48] get number(ret=0, service_type_=0, range=1, base_id=1745215735623247000, start_id=1745215735623247000, end_id=1745215735623247001) [2025-04-21 14:08:55.626287] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4040, offset=68445}, end_cursor:ObLogCursor{file_id=3, log_id=4041, offset=68742}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774ec050, len:1187, log_data_len:297, seq:4040, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:55.626553] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5C-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:55.626608] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5C-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215735200533002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215735200533002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:55.638270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215735638256000, start_id=1745215735638256000, end_id=1745215735638256001) [2025-04-21 14:08:55.657108] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.665683] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1745215735665680, bytes: 4711366, bw: 0.013929 MB/s, add_ts: 1007581, add_bytes: 14716 [2025-04-21 14:08:55.677828] INFO [SHARE] end_run (ob_tenant_base.cpp:334) [620355][T1002_DAG][T0][Y0-0000000000000000-0-0] [lt=24] tenant thread end_run(id_=1002, ret=0, thread_count_=150) [2025-04-21 14:08:55.678107] INFO destroy_tg (thread_mgr.cpp:91) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] destroy tg(tg_id=467, tg=0x7f3c53208780, tg->attr_={name:DagWorker, type:2}) [2025-04-21 14:08:55.678168] INFO [COMMON] try_reclaim_threads (ob_tenant_dag_scheduler.cpp:4893) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=56] reclaim threads(free_cnt=1, total_worker_cnt=0, work_thread_num_=43) [2025-04-21 14:08:55.695117] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695201] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695214] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695279] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695281] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695325] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695327] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695362] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=19] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.695515] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.696142] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.696349] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:55.698167] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=60] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:55.701500] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215735701268000, start_id=1745215735701268000, end_id=1745215735701268001) [2025-04-21 14:08:55.701549] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=45] handle gts request statistics(total_rt=445, total_cnt=60, avg_rt=7.295081967213114638e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:08:55.701601] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=33] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:55.701810] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215735701793], gts:1745215735701268000, latest_srr:[mts=1745215735701793]}) [2025-04-21 14:08:55.708327] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=24] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17351884}, readable_log_tail:{lsn:17351884}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49752884, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:55.708458] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=129] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:08:55.708482] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8769418}, readable_log_tail:{lsn:8769418}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58335350, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:55.708547] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=63] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:08:55.708583] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=14] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:55.717740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:55.741314] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=87] PNIO [ratelimit] time: 1745215735741309, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2025-04-21 14:08:55.745209] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=25] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:08:55.745254] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=40] finish to resize log external storage handler(current_ts=1745215735745250, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:55.750174] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] Garbage Collector is running(seq_=13, gc_interval=10000000) [2025-04-21 14:08:55.750270] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=45] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:55.750314] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:55.750355] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=31] gc_check_member_list_ cost time(ret=0, time_us=133) [2025-04-21 14:08:55.750385] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:55.750653] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:08:55.752191] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:55.753519] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:55.753563] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:55.753591] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:55.753616] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] execute_gc cost time(ret=0, time_us=55) [2025-04-21 14:08:55.753632] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2025-04-21 14:08:55.753878] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6200000, replace_num=100000) [2025-04-21 14:08:55.753925] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:55.757190] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.760636] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9F-0-0] [lt=19] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:08:55.760681] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFD9F-0-0] [lt=37] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:08:55.782375] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00A6-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.784713] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00A8-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.789711] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=59] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:55.797816] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00AB-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.798464] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00AC-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:55.813642] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:08:55.813698] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:55.820859] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:08:55.827652] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:55.827705] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:08:55.827724] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:55.827751] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:55.827779] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254940377890, flush_io_finished_ret_:0, flush_io_finished_round_:127, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:55.832295] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:55.838427] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:55.839877] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215735638256000, v:0}, new_max_version={val:1745215735638256000, v:0}, last_min_version={val:1745215735437492000, v:0}, last_max_version={val:1745215735437492000, v:0}, total_time_us=3141, delta_us=201618) [2025-04-21 14:08:55.839921] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215735638256000, v:0}, min_version={val:1745215735638256000, v:0}, max_version={val:1745215735638256000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:55.844897] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10225, max_lsn:17352006, max_scn:{val:1745215735701268000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17352006}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17351884}, last_submit_end_lsn:{lsn:17352006}, last_submit_log_id:10225, last_submit_log_pid:3, max_flushed_lsn:{lsn:17351884}, max_flushed_end_lsn:{lsn:17352006}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17352006}, last_slide_log_id:10225, last_slide_scn:{val:1745215735701268000, v:0}, last_slide_lsn:{lsn:17351884}, last_slide_end_lsn:{lsn:17352006}, last_slide_log_pid:3, last_slide_log_accum_checksum:340728589, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10226, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17352006}, readable_log_tail:{lsn:17352006}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49752762, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:08:55.845155] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=253] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215735794553, last_flushed_end_lsn:{lsn:17352006}}]) [2025-04-21 14:08:55.845193] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10226, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215735794553, last_flushed_end_lsn:{lsn:17352006}}]) [2025-04-21 14:08:55.845235] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14162, max_lsn:8769540, max_scn:{val:1745215735701268000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8769540}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8769418}, last_submit_end_lsn:{lsn:8769540}, last_submit_log_id:14162, last_submit_log_pid:3, max_flushed_lsn:{lsn:8769418}, max_flushed_end_lsn:{lsn:8769540}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8769540}, last_slide_log_id:14162, last_slide_scn:{val:1745215735701268000, v:0}, last_slide_lsn:{lsn:8769418}, last_slide_end_lsn:{lsn:8769540}, last_slide_log_pid:3, last_slide_log_accum_checksum:676642842, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14163, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8769540}, readable_log_tail:{lsn:8769540}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58335228, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:08:55.845402] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=163] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215735794624, last_flushed_end_lsn:{lsn:8769540}}]) [2025-04-21 14:08:55.845428] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14163, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215735794624, last_flushed_end_lsn:{lsn:8769540}}]) [2025-04-21 14:08:55.846799] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:08:55.857270] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.873947] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:55.873992] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=37] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.884687] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE43-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:55.884747] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE43-0-0] [lt=57] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:55.917420] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5641) [2025-04-21 14:08:55.917482] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1504, avg_log_submit_to_slide_time=1525) [2025-04-21 14:08:55.918224] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:55.944962] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=599) [2025-04-21 14:08:55.946136] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=55] BlockGCTimerTask success(ret=0, cost_time_us=12, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:08:55.954043] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:55.954176] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:55.954232] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:55.957336] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:55.958176] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=38] current monitor number(seq_=-1) [2025-04-21 14:08:55.964005] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=70][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:55.970580] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:56.035899] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=66] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:56.038184] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFCA-0-0] [lt=21] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:56.057404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.076030] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:56.076095] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.116381] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5519) [2025-04-21 14:08:56.116409] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:08:56.116453] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=41] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:56.116480] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:08:56.116510] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=28] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:56.117712] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:08:56.117754] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=41] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=2676, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:08:56.117789] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=34] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:08:56.117811] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=21] [APPLY STAT CB EXECUTE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=-541, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:08:56.117831] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00E4-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=2197, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:08:56.118646] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43605213184, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:56.119673] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=20] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:08:56.120011] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=333] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:56.129593] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:08:56.130972] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFD9F-0-0] [lt=37] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:08:56.131151] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1745215736130848000, start_id=1745215736130848000, end_id=1745215736130848001) [2025-04-21 14:08:56.154137] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:56.157486] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.167898] WDIAG begin (ob_hashtable.h:954) [620070][T1_L0_G0][T1][YB420B1D7AB6-00063343B5EEFD87-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.170257] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620070][T1_L0_G0][T1][YB420B1D7AB6-00063343B5EEFD87-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254941720545, cache_obj->added_lc()=false, cache_obj->get_object_id()=686, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:56.202049] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=30] ts response task statistics(alloc_count=2814, free_count=1406) [2025-04-21 14:08:56.236803] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD6-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:56.252469] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF9-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:56.252526] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDF9-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:56.257570] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.303682] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE47-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:56.303754] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE47-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:56.316532] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:56.316619] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:56.316803] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:56.316991] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:56.317109] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:13, schedule:40, submit:9, rt:1328, total:1392) [2025-04-21 14:08:56.317188] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:56.317274] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=76] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:13, schedule:40, submit:9, device:1328, total:1392) [2025-04-21 14:08:56.317340] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:56.317418] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:748, total:765) [2025-04-21 14:08:56.317503] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:56.317543] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:748, total:765) [2025-04-21 14:08:56.317604] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:56.317644] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:56.319139] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:56.354259] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:56.357643] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.374120] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:56.374173] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.392619] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:56.392675] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2025-04-21 14:08:56.392703] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:56.392732] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:56.392778] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:56.393933] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1261, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:56.393976] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:08:56.394012] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=160, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:56.394014] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1282, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:56.394045] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:56.394051] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:56.394089] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1486, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:56.394115] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:56.394153] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:56.394173] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1547, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:56.394194] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:56.400793] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:08:56.403686] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:08:56.403743] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:56.420726] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:08:56.424223] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:56.432021] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=60] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:56.432078] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:08:56.432096] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:56.432128] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:56.432159] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=30] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254940982248, flush_io_finished_ret_:0, flush_io_finished_round_:128, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:56.432384] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:56.438979] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8261, avg_group_log_size=516) [2025-04-21 14:08:56.439021] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8262) [2025-04-21 14:08:56.440184] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1315, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:56.440235] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=28, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:56.440270] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:56.440307] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1425, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:56.440327] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=1391, avg_log_submit_to_slide_time=1405) [2025-04-21 14:08:56.440362] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:56.440389] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8261, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:56.454383] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:56.454439] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.457715] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.475061] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.475638] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.475710] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.475769] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.477068] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8261) [2025-04-21 14:08:56.477166] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8261) [2025-04-21 14:08:56.493981] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1522) [2025-04-21 14:08:56.494048] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1487, avg_log_submit_to_slide_time=1501) [2025-04-21 14:08:56.494106] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:08:56.494141] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1444, avg_log_submit_to_slide_time=1456) [2025-04-21 14:08:56.494205] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1522, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:56.494246] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:56.516677] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:56.516732] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4862, avg_group_log_size=405) [2025-04-21 14:08:56.516765] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:56.518051] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1405, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:56.518094] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4862) [2025-04-21 14:08:56.518124] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:56.518190] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:56.518249] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1531, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:56.518293] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:56.518345] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4862, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:56.519609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:56.554365] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:56.557811] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.569275] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:56.569337] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=50] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:56.569385] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215736370747000, v:0}, base_version={val:1745215736170415000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215736370747000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215736569329, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:56.576229] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:56.576294] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.577225] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:56.582897] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:56.582953] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:08:56.582978] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:56.583008] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:56.583033] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254941133128, flush_io_finished_ret_:0, flush_io_finished_round_:128, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:56.592774] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1522) [2025-04-21 14:08:56.592843] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:08:56.592884] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:08:56.594202] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:56.594329] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1522) [2025-04-21 14:08:56.600130] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2025-04-21 14:08:56.600169] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:08:56.600207] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:56.604495] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:56.604551] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:56.606245] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:56.606284] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:56.608573] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDC9-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.608573] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDA0-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.608573] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00AE-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.611595] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00B0-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.611737] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDCB-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.611821] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDA2-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.613800] INFO [LIB] runTimerTask (ob_work_queue.cpp:24) [619568][RSInspectTask][T0][Y0-0000000000000000-0-0] [lt=53] add async task(this=tasktype:N9oceanbase10rootserver21ObPurgeRecyclebinTaskE) [2025-04-21 14:08:56.628024] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F6-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.630501] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00F6-0-0] [lt=48][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254942180808, cache_obj->added_lc()=false, cache_obj->get_object_id()=687, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:56.631811] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FA-0-0] [lt=44][errcode=-4201] hashtable not init [2025-04-21 14:08:56.631849] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FA-0-0] [lt=36] get cursor info failed(cursor_id=40, get_sessid()=3221487630) [2025-04-21 14:08:56.631995] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215736631973000, start_id=1745215736631973000, end_id=1745215736631973001) [2025-04-21 14:08:56.632339] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=35] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4041, offset=68742}, end_cursor:ObLogCursor{file_id=3, log_id=4042, offset=69048}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774f0050, len:890, log_data_len:306, seq:4041, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:56.632616] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5D-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:56.632688] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5D-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215736201463001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215736201463001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:56.634862] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:56.637273] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=48] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:56.638670] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4042, offset=69048}, end_cursor:ObLogCursor{file_id=3, log_id=4043, offset=69345}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774f4050, len:584, log_data_len:297, seq:4042, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:56.638917] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5D-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:56.638970] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5D-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215736201463001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215736201463001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:56.640504] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:56.657895] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.662397] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620394][DDLScanTask][T1][YB420B1D7AB6-00063343B97EFD88-0-0] [lt=52] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12208, add_timestamp:1745215736662374}) [2025-04-21 14:08:56.662487] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0A-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12208, locations=[{table_id:12208, partition_id:12208, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215736662448, sql_renew_time:1745215736662448, is_mark_fail:false}]) [2025-04-21 14:08:56.662577] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0A-0-0] [lt=88] success to process renew task(task={tenant_id:1, table_id:12208, add_timestamp:1745215736662374}, locations=[{table_id:12208, partition_id:12208, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215736662448, sql_renew_time:1745215736662448, is_mark_fail:false}]) [2025-04-21 14:08:56.667524] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620394][DDLScanTask][T1][YB420B1D7AB6-00063343B97EFD89-0-0] [lt=37] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12255, add_timestamp:1745215736667506}) [2025-04-21 14:08:56.667566] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0B-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12255, locations=[{table_id:12255, partition_id:12255, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215736667551, sql_renew_time:1745215736667551, is_mark_fail:false}]) [2025-04-21 14:08:56.667606] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0B-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:12255, add_timestamp:1745215736667506}, locations=[{table_id:12255, partition_id:12255, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215736667551, sql_renew_time:1745215736667551, is_mark_fail:false}]) [2025-04-21 14:08:56.673274] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215736673270, bytes: 4724138, bw: 0.012089 MB/s, add_ts: 1007590, add_bytes: 12772 [2025-04-21 14:08:56.678271] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] [COMPACTION DAG STATUS] (start_time=1745215726675285, end_time=1745215736678268, dag_status={}) [2025-04-21 14:08:56.678315] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678344] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678363] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678399] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678456] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678475] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:08:56.678493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678517] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678537] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678576] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678636] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678657] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678677] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678710] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678745] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678824] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678860] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678881] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678922] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678941] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678961] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678980] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.678999] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679039] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679060] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679081] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679121] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679141] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679160] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679181] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679201] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679260] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679300] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679320] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679340] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679380] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679400] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679419] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679457] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679476] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679496] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679515] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679607] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679627] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679647] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679665] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679685] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679791] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679859] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679920] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679972] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.679993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:08:56.680014] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:08:56.680033] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:08:56.680054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:08:56.680078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:08:56.680104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:08:56.680131] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:08:56.680156] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:08:56.680181] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:08:56.680206] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:08:56.680231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:08:56.680259] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:08:56.693345] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00B2-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.694848] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.694908] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695311] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=57] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695378] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695417] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695740] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695794] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.695839] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.696129] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.696218] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.696730] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:56.697217] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1745215736696184000, start_id=1745215736696184000, end_id=1745215736696184001) [2025-04-21 14:08:56.699201] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00B6-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.702506] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:56.702565] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215736702548], gts:1745215736701537000, latest_srr:[mts=1745215736702548]}) [2025-04-21 14:08:56.712772] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=17] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:56.713996] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:56.714095] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215728763799000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:56.720091] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:56.748942] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215736748935, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007626, add_bytes: 0 [2025-04-21 14:08:56.754497] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:56.757990] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.771306] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=82] get number(ret=0, service_type_=0, range=1, base_id=1745215736771266000, start_id=1745215736771266000, end_id=1745215736771266001) [2025-04-21 14:08:56.785888] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00B8-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.787999] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00BA-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.789823] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:56.798319] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=45] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:08:56.801895] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00BD-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.802470] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00BE-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:56.809756] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=20] ====== traversal_flush timer task ====== [2025-04-21 14:08:56.809867] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA0-0-0] [lt=47] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:56.810002] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA0-0-0] [lt=127] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:56.820958] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:56.827896] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:56.827945] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:08:56.827967] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:56.827991] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:56.828013] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254941378138, flush_io_finished_ret_:0, flush_io_finished_round_:128, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:56.832436] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:56.839024] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:56.840459] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215736638364000, v:0}, new_max_version={val:1745215736638364000, v:0}, last_min_version={val:1745215736438060000, v:0}, last_max_version={val:1745215736438060000, v:0}, total_time_us=2961, delta_us=202092) [2025-04-21 14:08:56.840497] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215736638364000, v:0}, min_version={val:1745215736638364000, v:0}, max_version={val:1745215736638364000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:56.843068] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:56.844041] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=39] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:56.844102] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:56.844173] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:56.844266] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=89] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:08:56.844315] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:56.844343] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215728563901001, v:0}) [2025-04-21 14:08:56.844363] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:08:56.844382] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:08:56.844406] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:56.844439] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:56.844466] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:56.844500] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:56.844535] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:56.844556] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:56.858058] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.874277] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:56.874330] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.886314] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE44-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:56.886380] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE44-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:56.907742] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:56.918505] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3972) [2025-04-21 14:08:56.918576] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1528, avg_log_submit_to_slide_time=1548) [2025-04-21 14:08:56.920588] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:56.924456] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=65] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:56.929800] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=35] runTimer to refresh locality_info(ret=0) [2025-04-21 14:08:56.931867] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=31] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:08:56.931930] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=51] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:08:56.931955] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=24] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:08:56.931983] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=20] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:08:56.931999] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:08:56.932023] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:08:56.932058] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=34] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:08:56.932089] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=27] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:08:56.935332] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=43] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:56.943598] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD91-0-0] [lt=43] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215732012500, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:56.943650] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD91-0-0] [lt=49] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215732014890, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:56.943672] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD91-0-0] [lt=21] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215732016785, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215732016780, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:08:56.954589] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:56.954618] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:56.954658] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:56.958131] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:56.958329] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:08:57.016261] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:57.016296] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=34] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:57.016323] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBC-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:57.016370] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBC-0-0] [lt=44] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:57.036044] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:57.038939] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFCF-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:57.040685] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619600][DiskUseReport][T1][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1745215737040390000, start_id=1745215737040390000, end_id=1745215737040390001) [2025-04-21 14:08:57.042126] INFO [SHARE] delete_tenant_all (ob_disk_usage_table_operator.cpp:231) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=40] delete successful (ret=0, tenant_id=500) [2025-04-21 14:08:57.042230] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [619600][DiskUseReport][T1][Y0-0000000000000000-0-0] [lt=41] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:57.045592] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [619600][DiskUseReport][T1001][Y0-0000000000000000-0-0] [lt=26] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:57.047112] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [619600][DiskUseReport][T1002][Y0-0000000000000000-0-0] [lt=26] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:57.050414] INFO [STORAGE] get_macro_block_count (ob_sn_tmp_file_manager.cpp:578) [619600][DiskUseReport][T1][Y0-0000000000000000-0-0] [lt=27] get tmp file macro block count(ret=0, ret="OB_SUCCESS", macro_block_count=0) [2025-04-21 14:08:57.050452] INFO [STORAGE] get_macro_block_count (ob_sn_tmp_file_manager.cpp:578) [619600][DiskUseReport][T1001][Y0-0000000000000000-0-0] [lt=33] get tmp file macro block count(ret=0, ret="OB_SUCCESS", macro_block_count=0) [2025-04-21 14:08:57.050467] INFO [STORAGE] get_macro_block_count (ob_sn_tmp_file_manager.cpp:578) [619600][DiskUseReport][T1002][Y0-0000000000000000-0-0] [lt=13] get tmp file macro block count(ret=0, ret="OB_SUCCESS", macro_block_count=0) [2025-04-21 14:08:57.052249] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=18][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb88d0 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001087} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb30a8 trans_version={val:1745215676965114000, v:0} scn={val:1745215676965114000, v:0} tx_id={txid:2000689} prev=0x7f3bfbcb2ef0 next=(nil) modify_count=4 acc_checksum=3557464390 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737051186000, v:0}, *this={this=0x7f3c14350d50 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=5 list_head=0x7f3bfbcb30a8 latest_compact_node=(nil) max_trans_version={val:1745215676965114000, v:0} max_trans_id=2000689 max_elr_trans_version={val:1745215676965114000, v:0} max_elr_trans_id=2000689 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=5 max_modify_scn={val:1745215676965114000, v:0} min_modify_scn={val:1745214012153425000, v:0}}) [2025-04-21 14:08:57.052334] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=84][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb88d0 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001087} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766951948, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766951948, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737051186000, v:0}, tx_id:{txid:2001087}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001087}, tx_desc:{this:0x7f3beadee460, tx_id:{txid:2001087}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737051186, active_ts:1745215737051186, commit_ts:-1, finish_ts:-1, timeout_us:29999983, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032852, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.052453] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=117][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001087}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.052483] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=28][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant file data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001087} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.052528] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=41][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.052553] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 323810B443330600, int: 1745215737051186}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 323810B443330600, int: 1745215737051186}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 7CBC080000000000, int: 572540}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 0000430000000000, int: 4390912}]}) [2025-04-21 14:08:57.052660] INFO [STORAGE] print_count (ob_query_iterator_factory.cpp:50) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=74] ObQueryIteratorFactory statistics(multi_scan_merge_alloc_count=0, multi_scan_merge_release_count=0, multi_get_merge_alloc_count=0, multi_get_merge_release_count=0, table_scan_alloc_count=0, table_scan_release_count=0, insert_dup_alloc_count=551, insert_dup_release_count=551, col_map_alloc_count=0, col_map_release_count=0) [2025-04-21 14:08:57.052698] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=27][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.052764] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA2-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001087} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.054670] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1, file_type=0, data_size=572540) [2025-04-21 14:08:57.055923] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=57][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb8b50 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001088} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:86} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c142b2d00 trans_version={val:1745214012156649001, v:0} scn={val:1745214012156649001, v:0} tx_id={txid:603} prev=(nil) next=(nil) modify_count=0 acc_checksum=1885783746 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:86} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737055513000, v:0}, *this={this=0x7f3c142b2c70 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c142b2d00 latest_compact_node=(nil) max_trans_version={val:1745215676968308001, v:0} max_trans_id=2000690 max_elr_trans_version={val:1745215676968308001, v:0} max_elr_trans_id=2000690 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214012156649001, v:0} min_modify_scn={val:1745214012156649001, v:0}}) [2025-04-21 14:08:57.055987] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=62][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb8b50 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001088} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:86} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766955748, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766955748, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737055513000, v:0}, tx_id:{txid:2001088}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001088}, tx_desc:{this:0x7f3beadf04c0, tx_id:{txid:2001088}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737055513, active_ts:1745215737055513, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032857, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.056075] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001088}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.056095] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=19][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant backup data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001088} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.056132] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.056153] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc0948d0, local_datums:0x7f3bcc0948d0}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09475c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094764, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094771, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094779, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x7f3bcc094781, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094793, hex: 194910B443330600, int: 1745215737055513}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09479b, hex: 194910B443330600, int: 1745215737055513}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a3, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947ab, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.056235] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=60][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.056277] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA3-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001088} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.057361] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1, file_type=8, data_size=0) [2025-04-21 14:08:57.058198] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.058593] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb8dc8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001089} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c14350168 trans_version={val:1745214072213450001, v:0} scn={val:1745214072213450001, v:0} tx_id={txid:1525} prev=(nil) next=(nil) modify_count=0 acc_checksum=919232952 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737057686000, v:0}, *this={this=0x7f3c0086afa8 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c14350168 latest_compact_node=(nil) max_trans_version={val:1745215676971503001, v:0} max_trans_id=2000691 max_elr_trans_version={val:1745215676971503001, v:0} max_elr_trans_id=2000691 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214072213450001, v:0} min_modify_scn={val:1745214072213450001, v:0}}) [2025-04-21 14:08:57.058656] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=62][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb8dc8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001089} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766958410, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766958410, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737057686000, v:0}, tx_id:{txid:2001089}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001089}, tx_desc:{this:0x7f3beadf4580, tx_id:{txid:2001089}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737057686, active_ts:1745215737057686, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032862, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.058759] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=101][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001089}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.058786] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant tmp data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001089} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.058822] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.058843] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc0948d0, local_datums:0x7f3bcc0948d0}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09475c, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094764, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094771, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094779, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x7f3bcc094781, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094790, hex: 965110B443330600, int: 1745215737057686}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094798, hex: 965110B443330600, int: 1745215737057686}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a0, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a8, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.058926] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.058970] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA4-0-0] [lt=18] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001089} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.060586] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1001, file_type=3, data_size=0) [2025-04-21 14:08:57.061803] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=32][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb9040 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001090} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c143aacb8 trans_version={val:1745214072216702000, v:0} scn={val:1745214072216702000, v:0} tx_id={txid:1526} prev=(nil) next=(nil) modify_count=0 acc_checksum=2065783039 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737060900000, v:0}, *this={this=0x7f3c143aac28 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c143aacb8 latest_compact_node=(nil) max_trans_version={val:1745215676974708001, v:0} max_trans_id=2000692 max_elr_trans_version={val:1745215676974708001, v:0} max_elr_trans_id=2000692 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214072216702000, v:0} min_modify_scn={val:1745214072216702000, v:0}}) [2025-04-21 14:08:57.061872] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=68][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb9040 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001090} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:84} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766961633, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766961633, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737060900000, v:0}, tx_id:{txid:2001090}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001090}, tx_desc:{this:0x7f3beadf65e0, tx_id:{txid:2001090}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737060900, active_ts:1745215737060900, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032867, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.061964] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=90][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001090}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.061984] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=20][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant tmp data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001090} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.062021] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.062042] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc0948d0, local_datums:0x7f3bcc0948d0}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09475c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094764, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094771, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094779, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x7f3bcc094781, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094790, hex: 245E10B443330600, int: 1745215737060900}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094798, hex: 245E10B443330600, int: 1745215737060900}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a0, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a8, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.062122] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.062164] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA5-0-0] [lt=18] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001090} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.063735] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1002, file_type=3, data_size=0) [2025-04-21 14:08:57.064936] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=37][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb92b8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001091} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb3c68 trans_version={val:1745215676978973000, v:0} scn={val:1745215676978973000, v:0} tx_id={txid:2000693} prev=0x7f3bfbcb3d38 next=(nil) modify_count=30 acc_checksum=2680475944 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737064138000, v:0}, *this={this=0x7f3c140ca7c0 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb3c68 latest_compact_node=0x7f3bfbcb3d38 max_trans_version={val:1745215676978973000, v:0} max_trans_id=2000693 max_elr_trans_version={val:1745215676978973000, v:0} max_elr_trans_id=2000693 latest_compact_ts=1745215676980465 last_compact_cnt=29 total_trans_node_cnt=31 max_modify_scn={val:1745215676978973000, v:0} min_modify_scn={val:1745214012159884001, v:0}}) [2025-04-21 14:08:57.065026] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=88][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb92b8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001091} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766964761, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766964761, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737064138000, v:0}, tx_id:{txid:2001091}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001091}, tx_desc:{this:0x7f3beadf8640, tx_id:{txid:2001091}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737064138, active_ts:1745215737064138, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032872, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.065133] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=105][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001091}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.065160] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant clog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001091} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.065197] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.065219] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: CA6A10B443330600, int: 1745215737064138}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: CA6A10B443330600, int: 1745215737064138}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: DEDDEB0700000000, int: 132898270}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: DEDDEB0700000000, int: 132898270}]}) [2025-04-21 14:08:57.065302] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=61][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.065349] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA6-0-0] [lt=22] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001091} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.067097] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=35] insert successful (ret=0, tenant_id=1, file_type=5, data_size=132898270) [2025-04-21 14:08:57.068291] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb9710 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001092} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c14309e30 trans_version={val:1745214072222739001, v:0} scn={val:1745214072222739001, v:0} tx_id={txid:1528} prev=(nil) next=(nil) modify_count=0 acc_checksum=1841226073 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737067353000, v:0}, *this={this=0x7f3c14309da0 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c14309e30 latest_compact_node=(nil) max_trans_version={val:1745215676982165000, v:0} max_trans_id=2000694 max_elr_trans_version={val:1745215676982165000, v:0} max_elr_trans_id=2000694 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214072222739001, v:0} min_modify_scn={val:1745214072222739001, v:0}}) [2025-04-21 14:08:57.068364] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb9710 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001092} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766968123, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766968123, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737067353000, v:0}, tx_id:{txid:2001092}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001092}, tx_desc:{this:0x7f3beadfa6a0, tx_id:{txid:2001092}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737067353, active_ts:1745215737067353, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032878, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.068459] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=93][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001092}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.068486] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant file data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001092} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.068523] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.068547] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=21][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 597710B443330600, int: 1745215737067353}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 597710B443330600, int: 1745215737067353}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 2EC7070000000000, int: 509742}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00C03B0000000000, int: 3915776}]}) [2025-04-21 14:08:57.068628] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=59][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.068670] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA7-0-0] [lt=18] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001092} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.069734] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1001, file_type=0, data_size=509742) [2025-04-21 14:08:57.070933] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=34][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb9990 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001093} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb43f8 trans_version={val:1745215676985365000, v:0} scn={val:1745215676985365000, v:0} tx_id={txid:2000695} prev=0x7f3bfbcb44c8 next=(nil) modify_count=8 acc_checksum=3401193917 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737070608000, v:0}, *this={this=0x7f3c0250c858 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb43f8 latest_compact_node=0x7f3bfbcb44c8 max_trans_version={val:1745215676985365000, v:0} max_trans_id=2000695 max_elr_trans_version={val:1745215676985365000, v:0} max_elr_trans_id=2000695 latest_compact_ts=1745215676987378 last_compact_cnt=7 total_trans_node_cnt=9 max_modify_scn={val:1745215676985365000, v:0} min_modify_scn={val:1745214072225954001, v:0}}) [2025-04-21 14:08:57.071002] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb9990 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001093} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766970768, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766970768, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737070608000, v:0}, tx_id:{txid:2001093}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001093}, tx_desc:{this:0x7f3beadfc700, tx_id:{txid:2001093}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737070608, active_ts:1745215737070608, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032883, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.071089] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=86][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001093}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.071115] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant file data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001093} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.071151] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=33][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.071172] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E742066696C652064617461, cstr: tenant file data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 108410B443330600, int: 1745215737070608}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 108410B443330600, int: 1745215737070608}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 88601C0000000000, int: 1859720}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00A0920000000000, int: 9609216}]}) [2025-04-21 14:08:57.071251] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.071294] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA8-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001093} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.073107] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=35] insert successful (ret=0, tenant_id=1002, file_type=0, data_size=1859720) [2025-04-21 14:08:57.074301] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=37][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb9c10 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001094} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfc247ee8 trans_version={val:1745214072229172001, v:0} scn={val:1745214072229172001, v:0} tx_id={txid:1531} prev=(nil) next=(nil) modify_count=0 acc_checksum=1536059851 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737073848000, v:0}, *this={this=0x7f3c025295d0 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfc247ee8 latest_compact_node=(nil) max_trans_version={val:1745215676988561001, v:0} max_trans_id=2000696 max_elr_trans_version={val:1745215676988561001, v:0} max_elr_trans_id=2000696 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214072229172001, v:0} min_modify_scn={val:1745214072229172001, v:0}}) [2025-04-21 14:08:57.074369] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=67][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb9c10 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001094} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766974131, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766974131, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737073848000, v:0}, tx_id:{txid:2001094}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001094}, tx_desc:{this:0x7f3beac049a0, tx_id:{txid:2001094}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737073848, active_ts:1745215737073848, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032888, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.074460] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=89][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001094}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.074480] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=19][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant backup data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001094} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.074516] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.074537] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094900, local_datums:0x7f3bcc094900}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09478c, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094794, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x7f3bcc0947b1, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947c3, hex: B89010B443330600, int: 1745215737073848}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947cb, hex: B89010B443330600, int: 1745215737073848}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d3, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947db, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.074618] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.074660] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDA9-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001094} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.076416] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:57.076470] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.076510] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=46] insert successful (ret=0, tenant_id=1001, file_type=8, data_size=0) [2025-04-21 14:08:57.077764] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcb9e88 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001095} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c02505af8 trans_version={val:1745214072231722001, v:0} scn={val:1745214072231722001, v:0} tx_id={txid:1532} prev=(nil) next=(nil) modify_count=0 acc_checksum=470580142 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737077089000, v:0}, *this={this=0x7f3c02505a68 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c02505af8 latest_compact_node=(nil) max_trans_version={val:1745215676991766001, v:0} max_trans_id=2000697 max_elr_trans_version={val:1745215676991766001, v:0} max_elr_trans_id=2000697 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214072231722001, v:0} min_modify_scn={val:1745214072231722001, v:0}}) [2025-04-21 14:08:57.077829] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=63][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcb9e88 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001095} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:87} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766977577, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766977577, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737077089000, v:0}, tx_id:{txid:2001095}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001095}, tx_desc:{this:0x7f3beac06a00, tx_id:{txid:2001095}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737077089, active_ts:1745215737077089, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032895, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.077917] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001095}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.077943] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant backup data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001095} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.077980] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.078001] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094900, local_datums:0x7f3bcc094900}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09478c, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094794, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 18, flag: 0, null: 0, ptr: 0x7f3bcc0947b1, hex: 74656E616E74206261636B75702064617461, cstr: tenant backup data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947c3, hex: 619D10B443330600, int: 1745215737077089}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947cb, hex: 619D10B443330600, int: 1745215737077089}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d3, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947db, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.078089] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=64][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.078133] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAA-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001095} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.079686] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1002, file_type=8, data_size=0) [2025-04-21 14:08:57.081794] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=500, file_type=5, data_size=536870912) [2025-04-21 14:08:57.082985] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=38][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcba2d0 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001097} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb4fc8 trans_version={val:1745215676998156000, v:0} scn={val:1745215676998156000, v:0} tx_id={txid:2000699} prev=0x7f3bfbcb5098 next=(nil) modify_count=28 acc_checksum=1771118914 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737082487000, v:0}, *this={this=0x7f3c024fe768 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb4fc8 latest_compact_node=0x7f3bfbcb5098 max_trans_version={val:1745215676998156000, v:0} max_trans_id=2000699 max_elr_trans_version={val:1745215676998156000, v:0} max_elr_trans_id=2000699 latest_compact_ts=1745215676999404 last_compact_cnt=27 total_trans_node_cnt=29 max_modify_scn={val:1745215676998156000, v:0} min_modify_scn={val:1745214072236082001, v:0}}) [2025-04-21 14:08:57.083059] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=74][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcba2d0 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001097} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766982825, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766982825, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737082487000, v:0}, tx_id:{txid:2001097}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001097}, tx_desc:{this:0x7f3beac0cb20, tx_id:{txid:2001097}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737082487, active_ts:1745215737082487, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032903, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.083148] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001097}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.083174] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant clog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001097} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.083211] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=36][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.083232] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 77B210B443330600, int: 1745215737082487}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 77B210B443330600, int: 1745215737082487}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: B8FA8E0500000000, int: 93256376}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: B8FA8E0500000000, int: 93256376}]}) [2025-04-21 14:08:57.083313] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=57][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.083355] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAC-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001097} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.085059] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1001, file_type=5, data_size=93256376) [2025-04-21 14:08:57.086256] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcba728 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001098} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb54d8 trans_version={val:1745215677000289001, v:0} scn={val:1745215677000289001, v:0} tx_id={txid:2000700} prev=0x7f3bfbcb55a8 next=(nil) modify_count=28 acc_checksum=2009860833 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737085734000, v:0}, *this={this=0x7f3c024f88a0 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb54d8 latest_compact_node=0x7f3bfbcb55a8 max_trans_version={val:1745215677000289001, v:0} max_trans_id=2000700 max_elr_trans_version={val:1745215677000289001, v:0} max_elr_trans_id=2000700 latest_compact_ts=1745215677002528 last_compact_cnt=27 total_trans_node_cnt=29 max_modify_scn={val:1745215677000289001, v:0} min_modify_scn={val:1745214072250623001, v:0}}) [2025-04-21 14:08:57.086323] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcba728 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001098} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766986086, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766986086, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737085734000, v:0}, tx_id:{txid:2001098}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001098}, tx_desc:{this:0x7f3beac0aac0, tx_id:{txid:2001098}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737085734, active_ts:1745215737085734, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032909, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.086411] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001098}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.086436] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant clog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001098} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.086472] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.086493] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420636C6F672064617461, cstr: tenant clog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 26BF10B443330600, int: 1745215737085734}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 26BF10B443330600, int: 1745215737085734}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: DBC38E0900000000, int: 160351195}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: DBC38E0900000000, int: 160351195}]}) [2025-04-21 14:08:57.086573] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=57][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.086615] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAD-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001098} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.088286] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=31] insert successful (ret=0, tenant_id=1002, file_type=5, data_size=160351195) [2025-04-21 14:08:57.089503] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=38][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbab80 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001099} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb59e8 trans_version={val:1745215677003486001, v:0} scn={val:1745215677003486001, v:0} tx_id={txid:2000701} prev=0x7f3bfbcb5830 next=(nil) modify_count=4 acc_checksum=624166019 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737088959000, v:0}, *this={this=0x7f3c0250b508 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=5 list_head=0x7f3bfbcb59e8 latest_compact_node=(nil) max_trans_version={val:1745215677003486001, v:0} max_trans_id=2000701 max_elr_trans_version={val:1745215677003486001, v:0} max_elr_trans_id=2000701 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=5 max_modify_scn={val:1745215677003486001, v:0} min_modify_scn={val:1745214012166252001, v:0}}) [2025-04-21 14:08:57.089571] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbab80 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001099} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766989336, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766989336, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737088959000, v:0}, tx_id:{txid:2001099}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001099}, tx_desc:{this:0x7f3beac12c40, tx_id:{txid:2001099}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737088959, active_ts:1745215737088959, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032915, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.089664] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=92][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001099}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.089684] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=20][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant local data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001099} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.089721] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.089742] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f2, hex: BFCB10B443330600, int: 1745215737088959}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947fa, hex: BFCB10B443330600, int: 1745215737088959}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094802, hex: 00E0CC0000000000, int: 13426688}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09480a, hex: 00E0CC0000000000, int: 13426688}]}) [2025-04-21 14:08:57.089831] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=66][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.089878] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAE-0-0] [lt=24] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001099} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.091498] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1, file_type=7, data_size=13426688) [2025-04-21 14:08:57.092708] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbae00 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001100} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb5e40 trans_version={val:1745215677006756000, v:0} scn={val:1745215677006756000, v:0} tx_id={txid:2000702} prev=0x7f3bfbcb5c88 next=(nil) modify_count=4 acc_checksum=3621487742 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737092188000, v:0}, *this={this=0x7f3c14132c38 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=5 list_head=0x7f3bfbcb5e40 latest_compact_node=(nil) max_trans_version={val:1745215677006756000, v:0} max_trans_id=2000702 max_elr_trans_version={val:1745215677006756000, v:0} max_elr_trans_id=2000702 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=5 max_modify_scn={val:1745215677006756000, v:0} min_modify_scn={val:1745214012169479001, v:0}}) [2025-04-21 14:08:57.092777] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=67][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbae00 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001100} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766992533, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766992533, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737092188000, v:0}, tx_id:{txid:2001100}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001100}, tx_desc:{this:0x7f3beac10be0, tx_id:{txid:2001100}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737092188, active_ts:1745215737092188, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737032920, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.092865] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=86][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001100}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.092892] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant slog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001100} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.092928] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.092949] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 5CD810B443330600, int: 1745215737092188}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 5CD810B443330600, int: 1745215737092188}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 0040020000000000, int: 147456}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 0040020000000000, int: 147456}]}) [2025-04-21 14:08:57.093050] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=79][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.093105] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDAF-0-0] [lt=28] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001100} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.095050] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1, file_type=4, data_size=147456) [2025-04-21 14:08:57.096293] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=40][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbb080 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001101} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb6298 trans_version={val:1745215677009962000, v:0} scn={val:1745215677009962000, v:0} tx_id={txid:2000703} prev=0x7f3bfbcb60e0 next=(nil) modify_count=2 acc_checksum=3890694058 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737095412000, v:0}, *this={this=0x7f3c00935318 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=3 list_head=0x7f3bfbcb6298 latest_compact_node=(nil) max_trans_version={val:1745215677009962000, v:0} max_trans_id=2000703 max_elr_trans_version={val:1745215677009962000, v:0} max_elr_trans_id=2000703 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=3 max_modify_scn={val:1745215677009962000, v:0} min_modify_scn={val:1745214072277459000, v:0}}) [2025-04-21 14:08:57.096362] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbb080 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001101} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766996108, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766996108, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737095412000, v:0}, tx_id:{txid:2001101}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001101}, tx_desc:{this:0x7f3beac0eb80, tx_id:{txid:2001101}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737095412, active_ts:1745215737095412, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737095412, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.096451] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=88][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001101}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.096478] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant local data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001101} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.096515] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.096530] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=12][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f2, hex: F4E410B443330600, int: 1745215737095412}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947fa, hex: F4E410B443330600, int: 1745215737095412}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094802, hex: 00A0B30000000000, int: 11771904}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09480a, hex: 00A0B30000000000, int: 11771904}]}) [2025-04-21 14:08:57.096611] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.096659] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB0-0-0] [lt=22] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001101} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.097746] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1001, file_type=7, data_size=11771904) [2025-04-21 14:08:57.098953] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=36][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbb300 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001102} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb66f0 trans_version={val:1745215677013157000, v:0} scn={val:1745215677013157000, v:0} tx_id={txid:2000704} prev=0x7f3bfbcb67c0 next=(nil) modify_count=8 acc_checksum=4089976063 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737098620000, v:0}, *this={this=0x7f3c143517b8 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb66f0 latest_compact_node=0x7f3bfbcb67c0 max_trans_version={val:1745215677013157000, v:0} max_trans_id=2000704 max_elr_trans_version={val:1745215677013157000, v:0} max_elr_trans_id=2000704 latest_compact_ts=1745215677014548 last_compact_cnt=7 total_trans_node_cnt=9 max_modify_scn={val:1745215677013157000, v:0} min_modify_scn={val:1745214072281779000, v:0}}) [2025-04-21 14:08:57.099023] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=68][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbb300 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001102} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:92} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215766998785, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215766998785, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737098620000, v:0}, tx_id:{txid:2001102}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001102}, tx_desc:{this:0x7f3beac14ca0, tx_id:{txid:2001102}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737098620, active_ts:1745215737098620, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737095417, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.099111] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001102}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.099138] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=25][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant local data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001102} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.099174] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.099194] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 17, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206C6F63616C2064617461, cstr: tenant local data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f2, hex: 7CF110B443330600, int: 1745215737098620}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947fa, hex: 7CF110B443330600, int: 1745215737098620}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094802, hex: 0090A00100000000, int: 27299840}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09480a, hex: 0090A00100000000, int: 27299840}]}) [2025-04-21 14:08:57.099275] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.099318] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB1-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001102} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.100978] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1002, file_type=7, data_size=27299840) [2025-04-21 14:08:57.103600] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=53] insert successful (ret=0, tenant_id=500, file_type=4, data_size=45056) [2025-04-21 14:08:57.104804] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=37][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbb748 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001104} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb6dc8 trans_version={val:1745215677017479001, v:0} scn={val:1745215677017479001, v:0} tx_id={txid:2000706} prev=0x7f3bfbcb6c10 next=(nil) modify_count=4 acc_checksum=2375246655 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737103997000, v:0}, *this={this=0x7f3c14925c28 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=5 list_head=0x7f3bfbcb6dc8 latest_compact_node=(nil) max_trans_version={val:1745215677017479001, v:0} max_trans_id=2000706 max_elr_trans_version={val:1745215677017479001, v:0} max_elr_trans_id=2000706 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=5 max_modify_scn={val:1745215677017479001, v:0} min_modify_scn={val:1745214012174848001, v:0}}) [2025-04-21 14:08:57.105086] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=280][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbb748 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001104} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:90} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767004641, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767004641, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737103997000, v:0}, tx_id:{txid:2001104}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001104}, tx_desc:{this:0x7f3beac18d60, tx_id:{txid:2001104}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737103997, active_ts:1745215737103997, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737095425, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.105178] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=91][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001104}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.105204] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=24][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant meta data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001104} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.105241] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.105263] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 7D0611B443330600, int: 1745215737103997}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 7D0611B443330600, int: 1745215737103997}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 00E0890000000000, int: 9035776}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00E0890000000000, int: 9035776}]}) [2025-04-21 14:08:57.105344] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.105388] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB3-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001104} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.107056] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1, file_type=1, data_size=9035776) [2025-04-21 14:08:57.108234] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=30][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbb9c8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001105} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb7220 trans_version={val:1745215677020687001, v:0} scn={val:1745215677020687001, v:0} tx_id={txid:2000707} prev=0x7f3bfbcb7068 next=(nil) modify_count=2 acc_checksum=2598169367 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737107230000, v:0}, *this={this=0x7f3c02512eb8 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=3 list_head=0x7f3bfbcb7220 latest_compact_node=(nil) max_trans_version={val:1745215677020687001, v:0} max_trans_id=2000707 max_elr_trans_version={val:1745215677020687001, v:0} max_elr_trans_id=2000707 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=3 max_modify_scn={val:1745215677020687001, v:0} min_modify_scn={val:1745214072291479001, v:0}}) [2025-04-21 14:08:57.108303] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=68][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbb9c8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001105} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767008071, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767008071, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737107230000, v:0}, tx_id:{txid:2001105}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001105}, tx_desc:{this:0x7f3beac1adc0, tx_id:{txid:2001105}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737107230, active_ts:1745215737107230, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737095430, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.108391] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001105}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.108418] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant slog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001105} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.108454] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.108475] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 1E1311B443330600, int: 1745215737107230}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 1E1311B443330600, int: 1745215737107230}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 00E0010000000000, int: 122880}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00E0010000000000, int: 122880}]}) [2025-04-21 14:08:57.108555] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=57][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.108597] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB4-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001105} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.109710] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1001, file_type=4, data_size=122880) [2025-04-21 14:08:57.110919] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=37][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbbc48 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001106} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb7678 trans_version={val:1745215677023906001, v:0} scn={val:1745215677023906001, v:0} tx_id={txid:2000708} prev=0x7f3bfbcb7748 next=(nil) modify_count=28 acc_checksum=2183928221 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737110448000, v:0}, *this={this=0x7f3c0091c150 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb7678 latest_compact_node=0x7f3bfbcb7748 max_trans_version={val:1745215677023906001, v:0} max_trans_id=2000708 max_elr_trans_version={val:1745215677023906001, v:0} max_elr_trans_id=2000708 latest_compact_ts=1745215677025717 last_compact_cnt=27 total_trans_node_cnt=29 max_modify_scn={val:1745215677023906001, v:0} min_modify_scn={val:1745214072293637001, v:0}}) [2025-04-21 14:08:57.110986] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=65][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbbc48 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001106} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767010750, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767010750, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737110448000, v:0}, tx_id:{txid:2001106}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001106}, tx_desc:{this:0x7f3beac1ce20, tx_id:{txid:2001106}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737110448, active_ts:1745215737110448, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737095435, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.111075] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001106}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.111096] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=19][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant slog data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001106} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.111132] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.111153] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E7420736C6F672064617461, cstr: tenant slog data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: B01F11B443330600, int: 1745215737110448}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: B01F11B443330600, int: 1745215737110448}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 00B00C0000000000, int: 831488}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00B00C0000000000, int: 831488}]}) [2025-04-21 14:08:57.111233] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.111275] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB5-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001106} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.113034] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1002, file_type=4, data_size=831488) [2025-04-21 14:08:57.115712] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=35] insert successful (ret=0, tenant_id=500, file_type=1, data_size=0) [2025-04-21 14:08:57.116892] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=35][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbc268 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001108} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb7d50 trans_version={val:1745215677029255001, v:0} scn={val:1745215677029255001, v:0} tx_id={txid:2000710} prev=0x7f3bfbcb7b98 next=(nil) modify_count=2 acc_checksum=3584045095 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737115837000, v:0}, *this={this=0x7f3c14309f90 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=3 list_head=0x7f3bfbcb7d50 latest_compact_node=(nil) max_trans_version={val:1745215677029255001, v:0} max_trans_id=2000710 max_elr_trans_version={val:1745215677029255001, v:0} max_elr_trans_id=2000710 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=3 max_modify_scn={val:1745215677029255001, v:0} min_modify_scn={val:1745214072299149001, v:0}}) [2025-04-21 14:08:57.116962] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=68][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbc268 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001108} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767016730, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767016730, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737115837000, v:0}, tx_id:{txid:2001108}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001108}, tx_desc:{this:0x7f3beac20ee0, tx_id:{txid:2001108}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737115837, active_ts:1745215737115837, commit_ts:-1, finish_ts:-1, timeout_us:29999986, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737112618, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.117069] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=105][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001108}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.117090] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=21][errcode=0] primary key duplication conflict(key={"BIGINT":1001},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant meta data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001108} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.117126] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.117147] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=18][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: E903000000000000, int: 1001}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: BD3411B443330600, int: 1745215737115837}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: BD3411B443330600, int: 1745215737115837}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 00E0770000000000, int: 7856128}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00E0770000000000, int: 7856128}]}) [2025-04-21 14:08:57.117232] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=61][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.117275] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB7-0-0] [lt=19] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001108} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.117484] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619600][DiskUseReport][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=18158) [2025-04-21 14:08:57.117870] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:08:57.117909] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=37] try gc retain ctx [2025-04-21 14:08:57.117928] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] try to retry start_working [2025-04-21 14:08:57.117973] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] finish update min start scn(max_decided_scn={val:1745215737068440000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215726963172001, v:0}, keep_alive_scn_:{val:1745215731966661001, v:0}, update_ts_:1745215737116906}) [2025-04-21 14:08:57.119011] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=33] insert successful (ret=0, tenant_id=1001, file_type=1, data_size=7856128) [2025-04-21 14:08:57.118983] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215745197259000, latest_log_ts:{val:1745215728563901001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:57.120190] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=31][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbc4e8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001109} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3bfbcb81a8 trans_version={val:1745215677032459001, v:0} scn={val:1745215677032459001, v:0} tx_id={txid:2000711} prev=0x7f3bfbcb8278 next=(nil) modify_count=6 acc_checksum=450538441 version=1745215609048422 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:7} write_epoch=3, snapshot_version={val:1745215737119099000, v:0}, *this={this=0x7f3c02534500 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3bfbcb81a8 latest_compact_node=0x7f3bfbcb8278 max_trans_version={val:1745215677032459001, v:0} max_trans_id=2000711 max_elr_trans_version={val:1745215677032459001, v:0} max_elr_trans_id=2000711 latest_compact_ts=1745215677034722 last_compact_cnt=5 total_trans_node_cnt=7 max_modify_scn={val:1745215677032459001, v:0} min_modify_scn={val:1745214072306653001, v:0}}) [2025-04-21 14:08:57.120257] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=66][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbc4e8 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001109} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:91} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767020028, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767020028, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737119099000, v:0}, tx_id:{txid:2001109}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001109}, tx_desc:{this:0x7f3beac22f40, tx_id:{txid:2001109}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737119099, active_ts:1745215737119099, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737112623, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.120347] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=88][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001109}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.120374] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1002},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant meta data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001109} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.120411] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=35][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.120432] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=19][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc094930, local_datums:0x7f3bcc094930}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947bc, hex: EA03000000000000, int: 1002}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc0947c4, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d1, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947d9, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 16, flag: 0, null: 0, ptr: 0x7f3bcc0947e1, hex: 74656E616E74206D6574612064617461, cstr: tenant meta data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f1, hex: 7B4111B443330600, int: 1745215737119099}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947f9, hex: 7B4111B443330600, int: 1745215737119099}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094801, hex: 00F00D0100000000, int: 17690624}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094809, hex: 00F00D0100000000, int: 17690624}]}) [2025-04-21 14:08:57.120511] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=58][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.120552] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB8-0-0] [lt=18] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001109} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.121140] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:57.121617] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1002, file_type=1, data_size=17690624) [2025-04-21 14:08:57.122817] WDIAG [STORAGE.TRANS] mvcc_sanity_check_ (ob_mvcc_row.cpp:943) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=32][errcode=-5024] find double insert node(ret=-5024, node=this=0x7f3bfbcbc768 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001110} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:83} seq_no={branch:0, seq:4} write_epoch=1, prev=this=0x7f3c008fd7e8 trans_version={val:1745214012181344001, v:0} scn={val:1745214012181344001, v:0} tx_id={txid:611} prev=(nil) next=(nil) modify_count=0 acc_checksum=3120381288 version=1745214012153460 type=0 flag=4 snapshot_barrier=1745215736971041000 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:83} seq_no={branch:0, seq:4} write_epoch=0, snapshot_version={val:1745215737122362000, v:0}, *this={this=0x7f3c008fd6a0 latch_=locked flag=3 first_dml=INSERT last_dml=INSERT update_since_compact=1 list_head=0x7f3c008fd7e8 latest_compact_node=(nil) max_trans_version={val:1745215677035671001, v:0} max_trans_id=2000712 max_elr_trans_version={val:1745215677035671001, v:0} max_elr_trans_id=2000712 latest_compact_ts=0 last_compact_cnt=0 total_trans_node_cnt=1 max_modify_scn={val:1745214012181344001, v:0} min_modify_scn={val:1745214012181344001, v:0}}) [2025-04-21 14:08:57.122885] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_row.cpp:1005) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=67][errcode=-5024] mvcc write failed(ret=-5024, node=this=0x7f3bfbcbc768 trans_version={val:4611686018427387903, v:0} scn={val:4611686018427387903, v:0} tx_id={txid:2001110} prev=(nil) next=(nil) modify_count=4294967295 acc_checksum=0 version=1745215609048422 type=0 flag=128 snapshot_barrier=0 snapshot_barrier_flag=0 mtd={dml_flag:3, buf_len:83} seq_no={branch:0, seq:4} write_epoch=1, ctx={this:0x7f3c77acaf20, ls_id:{id:1}, ls:0x7f3c5573e150, branch:0, timeout:1745215767022636, tablet_id:{id:309}, table_iter:0x7f3c77ac94f8, table_version:1745213986497320, mvcc_acc_ctx:{type:3, abs_lock_timeout_ts:1745215767022636, tx_lock_timeout_us:-1, snapshot:{version:{val:1745215737122362000, v:0}, tx_id:{txid:2001110}, scn:{branch:0, seq:2}}, tx_table_guards:{tx_table_guard:{tx_table:0x7f3c55748e50, epoch:1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_tx_table_guard:{tx_table:null, epoch:-1, mini_cache_:[0:{}, 1:{}, 2:{}, 3:{}]}, src_ls_handle:{ls_map_:null, ls_:null, mod_:-1}}, tx_id:{txid:2001110}, tx_desc:{this:0x7f3beac24fa0, tx_id:{txid:2001110}, state:1, addr:"11.29.122.182:2882", tenant_id:1, session_id:1, assoc_session_id:1, xid:NULL, xa_mode:"", xa_start_addr:"0.0.0.0:0", access_mode:0, tx_consistency_type:0, isolation:1, snapshot_version:{val:18446744073709551615, v:3}, snapshot_scn:0, active_scn:0, op_sn:2, alloc_ts:1745215737122362, active_ts:1745215737122362, commit_ts:-1, finish_ts:-1, timeout_us:29999987, lock_timeout_us:-1, expire_ts:9223372036854775807, coord_id:{id:-1}, parts:[], exec_info_reap_ts:0, commit_version:{val:18446744073709551615, v:3}, commit_times:0, commit_cb:null, cluster_id:1745213817, cluster_version:17180066817, seq_base:1745215737112628, flags_.SHADOW:false, flags_.INTERRUPTED:false, flags_.BLOCK:false, flags_.REPLICA:false, can_elr:false, conflict_txs:[], abort_cause:0, commit_expire_ts:0, commit_task_.is_registered():false, modified_tables:[], ref:2}, tx_ctx:0x7f3c6b5089d0, mem_ctx:0x7f3c6b509f50, tx_scn:{branch:0, seq:4}, write_flag:{is_table_api:0, is_table_lock:0, is_mds:0, is_dml_batch_opt:0, is_insert_up:1, is_write_only_index:0, is_check_row_locked:0, is_lob_aux:0, is_skip_flush_redo:0, is_update_uk:0}, handle_start_time:-1, lock_wait_start_ts:0}, tablet_stat:{ls_id:0, tablet_id:0, query_cnt:0, merge_cnt:0, scan_logical_row_cnt:0, scan_physical_row_cnt:0, scan_micro_block_cnt:0, pushdown_micro_block_cnt:0, exist_row_total_table_cnt:0, exist_row_read_table_cnt:0, insert_row_cnt:0, update_row_cnt:0, delete_row_cnt:0}, is_read_store_ctx:false, update_full_column:false}) [2025-04-21 14:08:57.122974] WDIAG [STORAGE.TRANS] mvcc_write (ob_mvcc_engine.cpp:337) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=87][errcode=-5024] mvcc write failed(ret=-5024, arg={tx_id:{txid:2001110}, data:0x7f3c77ac7f10, old_row:null, modify_count:4294967295, acc_checksum:0, memstore_version:1745215609048422, seq_no:{branch:0, seq:4}, write_epoch:1, scn:{val:4611686018427387903, v:0}, column_cnt:9}) [2025-04-21 14:08:57.123000] WDIAG [STORAGE.TRANS] on_key_duplication_retry (ob_memtable_context.cpp:320) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=26][errcode=0] primary key duplication conflict(key={"BIGINT":1},{"VARCHAR":"11.29.122.182", collation:"utf8mb4_general_ci"},{"BIGINT":2882},{"BIGINT":1},{"VARCHAR":"tenant tmp data", collation:"utf8mb4_general_ci"}, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=1 trans_id={txid:2001110} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=1 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=0, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(1,1,0,0,1,0,0,0)|]}}) [2025-04-21 14:08:57.123037] WDIAG [STORAGE] insert_row_without_rowkey_check (ob_tablet.cpp:4636) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=34][errcode=-5024] fail to set memtable(ret=-5024) [2025-04-21 14:08:57.123065] WDIAG [STORAGE] insert_row_to_tablet (ob_ls_tablet_service.cpp:5703) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=26][errcode=-5024] failed to write table row(ret=-5024, table id=309, col_descs=[cnt:9, column_id=18 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=19 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=20 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=21 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=22 {type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"} order=0, column_id=16 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=17 {type:"TIMESTAMP", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=23 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0, column_id=24 {type:"BIGINT", collation:"binary", coercibility:"NUMERIC"} order=0], datum_row={row_flag:{flag:"INSERT", flag_type:0}, trans_id:{txid:0}, scan_index:0, mvcc_row_flag:{first:0, uncommitted:0, shadow:0, compact:0, ghost:0, last:0, reserved:0, flag:0}, snapshot_version:0, fast_filter_skipped:false, have_uncommited_row:false, group_idx:0, count:9, datum_buffer:{capacity:16, datums:0x7f3bcc0948d0, local_datums:0x7f3bcc0948d0}, datums:[col_id=0:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc09475c, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=1:{len: 13, flag: 0, null: 0, ptr: 0x7f3bcc094764, hex: 31312E32392E3132322E313832, cstr: 11.29.122.182}, col_id=2:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094771, hex: 420B000000000000, int: 2882}, col_id=3:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094779, hex: 0100000000000000, int: 1, num_digit0: 0}, col_id=4:{len: 15, flag: 0, null: 0, ptr: 0x7f3bcc094781, hex: 74656E616E7420746D702064617461, cstr: tenant tmp data}, col_id=5:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094790, hex: 3A4E11B443330600, int: 1745215737122362}, col_id=6:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc094798, hex: 3A4E11B443330600, int: 1745215737122362}, col_id=7:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a0, hex: 0000000000000000, int: 0}, col_id=8:{len: 8, flag: 0, null: 0, ptr: 0x7f3bcc0947a8, hex: 0000000000000000, int: 0}]}) [2025-04-21 14:08:57.123148] WDIAG [STORAGE] insert_row (ob_ls_tablet_service.cpp:3397) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=59][errcode=-5024] failed to write row(ret=-5024) [2025-04-21 14:08:57.123191] INFO [STORAGE.TRANS] rollback (ob_memtable_context.cpp:844) [619600][DiskUseReport][T1][YB420B1D7AB6-00063343B98EFDB9-0-0] [lt=20] memtable handle rollback to successfuly(from_seq_no={branch:0, seq:5}, to_seq_no={branch:0, seq:3}, remove_cnt=1, elapsed=0, this={ObIMvccCtx={alloc_type=0 ctx_descriptor=0 min_table_version=1745213986497320 max_table_version=1745213986497320 trans_version={val:4611686018427387903, v:0} commit_version={val:0, v:0} lock_wait_start_ts=0 replay_compact_version={val:0, v:0}} end_code=0 tx_status=0 is_readonly=false ref=0 trans_id={txid:2001110} ls_id=1 row_callback[alloc:0, free:0, unsubmit:0] redo[fill:0,sync_succ:0, sync_fail:0] main_list_len=0 pending_log_size=0 callback_list:{cnt=1 stat:[tx_end=0, rollback_to=1, fast_commit=0, remove_memtable=0, ext_info_log=0] detail:[(log_epoch,length,logged,synced,appended,removed,unlog_removed,branch_removed)|0:(-1,0,0,0,1,1,1,0)|]}}) [2025-04-21 14:08:57.124757] INFO [SHARE] update_tenant_space_usage (ob_disk_usage_table_operator.cpp:126) [619600][DiskUseReport][T0][Y0-0000000000000000-0-0] [lt=32] insert successful (ret=0, tenant_id=1, file_type=3, data_size=0) [2025-04-21 14:08:57.137789] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215737038216000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215737137735}, version_delta=99570) [2025-04-21 14:08:57.154737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=37] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:57.158281] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.169964] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215736971041000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198913, in_cluster_service=true, cluster_version={val:1745215736771266000, v:0}, min_cluster_version={val:1745215736771266000, v:0}, max_cluster_version={val:1745215736771266000, v:0}, get_cluster_version_err=0, cluster_version_delta=398688, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1171, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=74700091, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:57.173585] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FC-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.175916] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FC-0-0] [lt=31][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254942726208, cache_obj->added_lc()=false, cache_obj->get_object_id()=688, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:57.203017] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=386, get_gts_with_stc_cnt=80, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=55, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:57.203063] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215737202987], gts:1745215737202090000, latest_srr:[mts=1745215737202987]}) [2025-04-21 14:08:57.248482] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC3-0-0] [lt=35] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:57.248547] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC3-0-0] [lt=57] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=68) [2025-04-21 14:08:57.254249] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFA-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:57.254306] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFA-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:57.258366] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.276148] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=93] get number(ret=0, service_type_=0, range=1, base_id=1745215737275601000, start_id=1745215737275601000, end_id=1745215737275601001) [2025-04-21 14:08:57.298000] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=62] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:57.305388] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE48-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:57.305452] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE48-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:57.318627] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:57.318699] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:57.318898] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:57.319085] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:57.319183] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:13, schedule:38, submit:7, rt:1182, total:1241) [2025-04-21 14:08:57.319266] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:57.319330] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:13, schedule:38, submit:7, device:1182, total:1241) [2025-04-21 14:08:57.319395] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:57.319471] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:474, total:491) [2025-04-21 14:08:57.319549] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:57.319587] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:474, total:491) [2025-04-21 14:08:57.319651] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:57.319677] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:57.321629] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:57.354867] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:57.358456] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.374463] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:57.374549] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.393358] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:57.393443] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:57.393492] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:57.393548] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:57.393593] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:57.394930] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1365, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:57.394976] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1841) [2025-04-21 14:08:57.395009] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:57.395030] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1389, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:57.395056] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:57.395077] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=75, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:57.395097] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1470, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:57.395128] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:57.395168] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:57.395189] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1554, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:57.395211] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:57.420798] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:57.425048] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:57.432529] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:57.439866] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8385, avg_group_log_size=493) [2025-04-21 14:08:57.439917] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:08:57.441148] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1358, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:57.441205] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:57.441262] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:57.441290] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1456, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:57.441309] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1420, avg_log_submit_to_slide_time=1435) [2025-04-21 14:08:57.441348] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:57.441396] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8385, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:57.454862] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=45] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:57.454948] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=75] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.458539] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.475581] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.475652] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.475712] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.476140] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.478268] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8385) [2025-04-21 14:08:57.478353] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8385) [2025-04-21 14:08:57.494776] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:57.494843] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1521, avg_log_submit_to_slide_time=1535) [2025-04-21 14:08:57.494889] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1841) [2025-04-21 14:08:57.494925] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1450, avg_log_submit_to_slide_time=1465) [2025-04-21 14:08:57.494971] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:57.495012] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1841, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:57.518186] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=89] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:57.518245] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=35, avg_log_batch_cnt=1, total_group_log_size=19826, avg_group_log_size=566) [2025-04-21 14:08:57.518274] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:57.519778] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=1207, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:57.519894] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=111] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=19826) [2025-04-21 14:08:57.519964] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:57.520029] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:57.520076] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG LIFE TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=1305, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:57.520115] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=35, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:57.520165] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=19826, hit_cnt=36, read_cnt=36, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:57.522338] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:57.531845] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=1000000, clean_num=200000) [2025-04-21 14:08:57.555019] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:57.558621] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.576618] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:57.576682] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.577337] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:08:57.593496] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:57.593572] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1841, avg_group_log_size=184) [2025-04-21 14:08:57.593605] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1841) [2025-04-21 14:08:57.594396] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:08:57.595037] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:57.598157] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:08:57.598301] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:08:57.601155] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=31] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:57.601211] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=41] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=26) [2025-04-21 14:08:57.604056] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:57.604098] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:57.605779] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:57.605814] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:57.605853] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC6-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:57.613080] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C0-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.613107] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDA3-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.613112] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDCC-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.615724] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C2-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.615812] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDCE-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.615870] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDA5-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.627372] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FE-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.629695] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FE-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254943180003, cache_obj->added_lc()=false, cache_obj->get_object_id()=689, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:57.644765] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4043, offset=69345}, end_cursor:ObLogCursor{file_id=3, log_id=4044, offset=69651}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774f8050, len:4383, log_data_len:306, seq:4043, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:57.645048] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5E-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:57.645115] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5E-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215737203139002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215737203139002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:57.650803] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4044, offset=69651}, end_cursor:ObLogCursor{file_id=3, log_id=4045, offset=69948}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c774fc050, len:4077, log_data_len:297, seq:4044, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:57.651031] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5E-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:57.651082] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5E-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215737203139002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215737203139002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:57.658724] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.680902] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215737680897, bytes: 4738361, bw: 0.013461 MB/s, add_ts: 1007627, add_bytes: 14223 [2025-04-21 14:08:57.689547] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=55] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585016995840, fast_delete_log_mode=false) [2025-04-21 14:08:57.694448] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.694529] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695472] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695629] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695819] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695845] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695839] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695885] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695925] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.695974] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.696222] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:57.703493] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:57.708842] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=53] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:57.709034] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDEF-0-0] [lt=32] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:57.709181] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDF1-0-0] [lt=41] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:57.732340] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:57.733626] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=53] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:57.744187] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDED-0-0] [lt=38] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:57.755151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:57.756565] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=90] PNIO [ratelimit] time: 1745215737756558, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2025-04-21 14:08:57.758826] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:57.758854] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:08:57.758878] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.789327] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C4-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.789942] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:57.791912] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C5-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.806668] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C8-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.807409] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00C9-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:57.813824] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:57.813899] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=66] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:57.821039] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:57.832558] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:57.840219] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:57.841952] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215737639074000, v:0}, new_max_version={val:1745215737639074000, v:0}, last_min_version={val:1745215737439096000, v:0}, last_max_version={val:1745215737439096000, v:0}, total_time_us=3609, delta_us=202875) [2025-04-21 14:08:57.841996] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215737639074000, v:0}, min_version={val:1745215737639074000, v:0}, max_version={val:1745215737639074000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:57.842025] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:08:57.848437] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:08:57.858856] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.874679] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:57.874758] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.887950] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE45-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:57.888024] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE45-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:57.892492] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=42] LogLoopThread round_cost_time(us)(round_cost_time=22) [2025-04-21 14:08:57.908433] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDD8-0-0] [lt=34] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:08:57.914465] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=53] ls blacklist refresh finish(cost_time=9125) [2025-04-21 14:08:57.919999] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=19388) [2025-04-21 14:08:57.920076] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=35, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1287, avg_log_submit_to_slide_time=1299) [2025-04-21 14:08:57.932876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:57.933247] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDF3-0-0] [lt=22] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:08:57.955111] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:57.955186] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:57.958480] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=41] current monitor number(seq_=-1) [2025-04-21 14:08:57.958932] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:57.960160] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6300000, replace_num=100000) [2025-04-21 14:08:57.960216] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:08:57.979245] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:08:58.034323] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFDFE-0-0] [lt=89] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:08:58.036196] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:08:58.041887] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFD4-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035524940490722656e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738959006513445047e+02) [2025-04-21 14:08:58.054026] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:08:58.054173] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=103] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:58.054201] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=210, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:58.054282] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:08:58.054367] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=44] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:08:58.054391] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=26, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:08:58.059025] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.076836] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:08:58.076918] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.118722] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5202) [2025-04-21 14:08:58.133401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:58.159119] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.160334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=21] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:08:58.179704] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FF-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.182223] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF00FF-0-0] [lt=51][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254943732530, cache_obj->added_lc()=false, cache_obj->get_object_id()=690, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:58.256312] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFB-0-0] [lt=24] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:58.256375] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFB-0-0] [lt=61] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:58.259229] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.276726] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45EFFDF-0-0] [lt=47] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215738276289, can_tenant_elr:true}) [2025-04-21 14:08:58.278801] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26157193, this={dio_aligned_buf:{buf_write_offset:726, buf_padding_size:3370, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:5876, truncate_used_ts:2410}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26157056, buf_len=589, total_write_size=86018, total_write_size_after_dio=778240, ob_pwrite_used_ts=257384, count=169, each_pwrite_cost=1522) [2025-04-21 14:08:58.307245] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE49-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:58.307321] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE49-0-0] [lt=72] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.320834] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:58.320908] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:58.321113] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:58.321303] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:58.321387] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12260, [delay/us]:prepare:13, schedule:42, submit:9, rt:1277, total:1342) [2025-04-21 14:08:58.321462] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:58.321526] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12261, [delay/us]: prepare:13, schedule:42, submit:9, device:1277, total:1342) [2025-04-21 14:08:58.321585] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:58.321659] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:604, total:621) [2025-04-21 14:08:58.321736] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:58.321772] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:604, total:621) [2025-04-21 14:08:58.321837] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:58.321864] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:58.333903] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:58.359308] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=89][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.360491] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:08:58.365486] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:58.366700] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:58.366802] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215731182505000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:58.374882] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:58.374940] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.394107] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:58.394180] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:58.394225] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:58.394264] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:58.394296] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:58.395831] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1692, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:58.395877] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=86, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:58.395929] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:58.395913] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1692, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:58.395976] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1875, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:58.395972] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:58.396002] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:58.396008] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:58.396044] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:58.396064] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1813, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:58.396086] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:58.402404] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=35] ====== tenant freeze timer task ====== [2025-04-21 14:08:58.403895] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:08:58.403948] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:08:58.420868] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:58.425999] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:58.432375] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:58.432450] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=66] temporary file module use no blocks [2025-04-21 14:08:58.432470] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:58.432497] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:58.432524] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254942982606, flush_io_finished_ret_:0, flush_io_finished_round_:130, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:58.432697] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:58.440876] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8381, avg_group_log_size=493) [2025-04-21 14:08:58.440924] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8381) [2025-04-21 14:08:58.442479] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1538, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:58.442550] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:58.442614] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:58.442656] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1695, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:58.442673] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1636, avg_log_submit_to_slide_time=1659) [2025-04-21 14:08:58.442727] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:58.442768] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8381, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:58.455349] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:58.455418] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.459394] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.475228] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.475457] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.475527] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.475784] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.478955] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8381) [2025-04-21 14:08:58.479059] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8381) [2025-04-21 14:08:58.495954] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:58.496044] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1813, avg_log_submit_to_slide_time=1836) [2025-04-21 14:08:58.496097] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:08:58.496076] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=23] [APPLY STAT CB APPEND COST TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=27, this=0x7f3c24966280, extra_info="") [2025-04-21 14:08:58.496123] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=46] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=1683, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:08:58.496125] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1880, avg_log_submit_to_slide_time=1891) [2025-04-21 14:08:58.496151] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=26] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:08:58.496185] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=32] [APPLY STAT CB EXECUTE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-629, this=0x7f3c24966910, extra_info="") [2025-04-21 14:08:58.496176] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:58.496205] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=1082, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:08:58.496213] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:58.518956] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=91] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:58.519043] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=69] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:08:58.519076] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:58.520922] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2105, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:58.520987] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:08:58.521040] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:58.521112] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:58.521158] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2300, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:58.521189] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:58.521231] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:58.534429] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:58.547775] INFO [STORAGE] normal_running_env_check_ (ob_tenant_snapshot_service.cpp:279) [620331][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=39] normal_running_env_check_ succ(this={is_inited_:true, is_running_:true, running_mode_:3, meta_loaded_:true, tg_id_:454}) [2025-04-21 14:08:58.547843] INFO [STORAGE] try_gc_tenant_snapshot_ (ob_tenant_snapshot_service.cpp:650) [620331][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=64] try_gc_tenant_snapshot finished(ret=0, ret="OB_SUCCESS", this={is_inited_:true, is_running_:true, running_mode_:3, meta_loaded_:true, tg_id_:454}) [2025-04-21 14:08:58.549622] INFO [STORAGE] calculate_idle_time_ (ob_tenant_snapshot_service.cpp:829) [620331][T1002_TSnapSvc][T1002][Y0-0000000000000000-0-0] [lt=24] ObTenantSnapshotService thread idle time(tg_id_=454, idle_time=60000, running_mode_=3) [2025-04-21 14:08:58.557017] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=68] clear dtl interm result cost(us)(clear_cost=372, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:08:58.559478] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.560649] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:08:58.565455] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:08:58.565624] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9F-0-0] [lt=53] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215738203192001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215735200533003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:58.565852] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9F-0-0] [lt=178] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215735200533003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:58.565947] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFD9F-0-0] [lt=92] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:08:58.569485] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:08:58.569534] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:08:58.572707] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=63] submit log success(service_type_=0, last_id=1745215755197259000, limited_id=1745215755197259000) [2025-04-21 14:08:58.572745] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] submit log with lock success(service_type_=0, last_id=1745215755197259000, limited_id=1745215755197259000) [2025-04-21 14:08:58.574702] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=18] update id meta(ret=0, service_type=0, limited_id=1745215755197259000, latest_scn={val:1745215738572266001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:08:58.574784] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=81] handle submit callback(service_type_=0, success=true, used_ts=2079, log_ts={val:1745215738572266001, v:0}, limited_id=1745215755197259000) [2025-04-21 14:08:58.574806] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:08:58.574821] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=14] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:08:58.576112] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF00FB-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215738575454000, start_id=1745215738575454000, end_id=1745215738575454001) [2025-04-21 14:08:58.577092] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:58.577157] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.577423] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:08:58.583257] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:58.583315] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:08:58.583333] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:58.583361] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:58.583387] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254943133478, flush_io_finished_ret_:0, flush_io_finished_round_:130, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:58.588743] INFO [CLOG] update_upstream (ob_remote_location_adaptor.cpp:91) [620276][T1002_LogRessvr][T1002][YB420B1D7AB6-00063343ADDEFD86-0-0] [lt=40] primary tenant, just skip [2025-04-21 14:08:58.594265] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:58.594339] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:08:58.594374] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:08:58.594590] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:58.596222] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:08:58.597863] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=49] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:58.599101] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=44] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:58.599195] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215735579281000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:58.603923] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=15] ====== tenant freeze timer task ====== [2025-04-21 14:08:58.603980] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=46] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:08:58.604020] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:08:58.604203] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:58.604247] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:58.606040] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:58.606076] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:58.617143] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDCF-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.617266] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00CB-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.617267] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDA6-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.619942] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00CD-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.620695] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00CE-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.621352] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00CF-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.643358] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=83] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:08:58.651013] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] ====== checkpoint timer task ====== [2025-04-21 14:08:58.652067] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=47] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:58.652134] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=66] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:58.652215] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=42] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215735200533003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:58.652329] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=108] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:08:58.652365] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:58.652395] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215734200261001, v:0}) [2025-04-21 14:08:58.652417] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:08:58.652443] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:58.652477] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:58.652502] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:58.652537] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:58.652574] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:58.653607] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:58.653651] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=44] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:58.653702] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215735200533003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:58.653776] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=72] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:08:58.653795] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:08:58.653820] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:58.653845] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:08:58.653868] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:08:58.653893] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:58.653921] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:08:58.653941] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:08:58.654346] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=47] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}) [2025-04-21 14:08:58.657861] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4045, offset=69948}, end_cursor:ObLogCursor{file_id=3, log_id=4046, offset=70254}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77500050, len:3780, log_data_len:306, seq:4045, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:58.658247] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5F-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:58.658324] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5F-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215738203192003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215738203192003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:58.659572] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.663692] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:58.663807] WDIAG read_multi_row (ob_table_access_helper.h:238) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:08:58.665375] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=63] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4046, offset=70254}, end_cursor:ObLogCursor{file_id=3, log_id=4047, offset=70551}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77504050, len:3474, log_data_len:297, seq:4046, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:58.665427] INFO delete_row (ob_table_access_helper.h:312) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=31] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215738663839) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215738663839) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:08:58.665580] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:08:58.665672] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5F-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:58.665738] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE5F-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215738203192003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215738203192003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:58.677581] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE46-0-0] [lt=17] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.680568] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=38] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745300457074037, last_date_:0, this_date_:0, next_date_:1745300457074037, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:08:58.680704] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=133] check all tenants(ret=0) [2025-04-21 14:08:58.682163] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE49-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.683527] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4A-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.684862] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4B-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.686197] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=71] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:58.686247] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4C-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.687575] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4D-0-0] [lt=30] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.688513] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215738688509, bytes: 4751133, bw: 0.012088 MB/s, add_ts: 1007612, add_bytes: 12772 [2025-04-21 14:08:58.688920] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4E-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.692275] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE4F-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.695077] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695148] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695190] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695474] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695669] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695668] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695722] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695738] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695775] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695797] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.695885] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:58.704492] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=45] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:58.704777] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=41] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215738704754], gts:1745215738703981000, latest_srr:[mts=1745215738704754]}) [2025-04-21 14:08:58.734982] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:58.759641] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.760780] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:08:58.762982] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA1-0-0] [lt=45] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:08:58.764165] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215738764160, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2025-04-21 14:08:58.790083] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=63] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:58.793107] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00D1-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.794407] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:08:58.794457] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] try gc retain ctx [2025-04-21 14:08:58.794472] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:58.794528] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] finish update min start scn(max_decided_scn={val:1745215738203192004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215728693381000, v:0}, keep_alive_scn_:{val:1745215733698951000, v:0}, update_ts_:1745215738793898}) [2025-04-21 14:08:58.794940] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00D3-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.795588] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215736201463002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:58.795749] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=100] finish update min start scn(max_decided_scn={val:1745215738203192004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215728693381000, v:0}, keep_alive_scn_:{val:1745215733698951000, v:0}, update_ts_:1745215738794964}) [2025-04-21 14:08:58.796765] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215736201463002, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:58.797138] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=48, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:08:58.797180] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=41] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=1607, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:08:58.797195] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:08:58.797213] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=16] [APPLY STAT CB EXECUTE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=-433, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:08:58.797231] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F00B5-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=1222, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:08:58.811280] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00D6-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.812389] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00D7-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:58.821108] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:08:58.828097] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=51] ObArchiveSender is running(thread_index=1) [2025-04-21 14:08:58.828228] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=38] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:58.828288] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:08:58.828311] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:58.828337] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:58.828359] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254943378454, flush_io_finished_ret_:0, flush_io_finished_round_:130, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:58.832749] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=66] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:58.840963] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:58.842798] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215738640041000, v:0}, new_max_version={val:1745215738640041000, v:0}, last_min_version={val:1745215738439913000, v:0}, last_max_version={val:1745215738439913000, v:0}, total_time_us=3466, delta_us=202754) [2025-04-21 14:08:58.842844] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215738640041000, v:0}, min_version={val:1745215738640041000, v:0}, max_version={val:1745215738640041000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:58.859713] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.875041] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:58.875097] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.889849] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE50-0-0] [lt=37] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:58.889929] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE50-0-0] [lt=77] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:58.916507] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:08:58.919210] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=103] get number(ret=0, service_type_=0, range=1, base_id=1745215738918158000, start_id=1745215738918158000, end_id=1745215738918158001) [2025-04-21 14:08:58.921189] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3663) [2025-04-21 14:08:58.921361] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=135] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=169, avg_log_gen_to_submit_time=194, avg_log_submit_to_flush_time=2112, avg_log_submit_to_slide_time=2152) [2025-04-21 14:08:58.935517] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:58.955578] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:58.955651] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:58.959782] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:58.960887] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:08:58.975891] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=50] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215738203192004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=772686, in_cluster_service=true, cluster_version={val:1745215738203192003, v:0}, min_cluster_version={val:1745215738203192003, v:0}, max_cluster_version={val:1745215738203192003, v:0}, get_cluster_version_err=0, cluster_version_delta=772686, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1159, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=69851614, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:08:58.996256] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:58.996308] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:08:58.996914] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] update_check_range(min_check_version=12, max_check_version=13, global_version=14) [2025-04-21 14:08:59.013524] INFO [SHARE] run1 (ob_dynamic_thread_pool.cpp:594) [619612][qth_mgr][T0][Y0-0000000000000000-0-0] [lt=56] [thread pool stat](pool_stat={pool:0x7f3c901e9480, last_check_time:1745215739013518, last_idle_time:140689120, last_thread_count:1}, *pool={name:IO_SYNC_CH, this:0x7f3c901e9480, min_thread_cnt:1, max_thread_cnt:96, running_thread_cnt:0, threads_idle_time:140689120, tenant_id:500}, qsize=-1, current_idle_time=140689120) [2025-04-21 14:08:59.017133] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=19] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:59.017179] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=45] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:08:59.017188] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8B-0-0] [lt=19] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:59.017235] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8B-0-0] [lt=44] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:08:59.020212] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 232 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 87 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 21 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 94 245 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 23341 [2025-04-21 14:08:59.020276] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=36] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,076,969,472 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:59.020600] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,215,344 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,767,744 used= 4,194,304 count= 70 avg_used= 59,918 block_cnt= 70 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,169,792 used= 3,038,592 count= 656 avg_used= 4,632 block_cnt= 656 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,489,280 used= 1,409,512 count= 39 avg_used= 36,141 block_cnt= 39 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 7 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 601,472 used= 587,264 count= 74 avg_used= 7,936 block_cnt= 74 chunk_cnt= 13 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 378,880 used= 363,520 count= 80 avg_used= 4,544 block_cnt= 80 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 211,328 used= 206,336 count= 26 avg_used= 7,936 block_cnt= 26 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 105,664 used= 103,168 count= 13 avg_used= 7,936 block_cnt= 13 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 105,664 used= 103,168 count= 13 avg_used= 7,936 block_cnt= 13 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 9,168 used= 6,656 count= 13 avg_used= 512 block_cnt= 12 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,112 used= 5,512 count= 13 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,456 used= 2,304 count= 6 avg_used= 384 block_cnt= 5 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,215,344 used= 376,080,636 count= 32,178 avg_used= 11,687 mod=SUMMARY [2025-04-21 14:08:59.020650] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:08:59.020676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:08:59.020707] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 87,228,544 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 82,300,032 used= 74,749,471 count= 3,724 avg_used= 20,072 block_cnt= 3,724 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,501,248 used= 3,294,736 count= 362 avg_used= 9,101 block_cnt= 362 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,425,280 used= 1,299,520 count= 655 avg_used= 1,984 block_cnt= 219 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 87,228,544 used= 79,345,327 count= 4,743 avg_used= 16,728 mod=SUMMARY [2025-04-21 14:08:59.020739] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:08:59.020765] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:08:59.020802] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:08:59.020829] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:08:59.020855] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:59.020887] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:08:59.020912] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:08:59.020951] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,715,776 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,845,056 used= 1,801,472 count= 227 avg_used= 7,936 block_cnt= 227 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,715,776 used= 19,643,200 count= 231 avg_used= 85,035 mod=SUMMARY [2025-04-21 14:08:59.020981] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:08:59.021034] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:08:59.021072] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:08:59.021358] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,327,696 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:08:59.077342] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.119422] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3663) [2025-04-21 14:08:59.135991] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:59.159884] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.161025] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:08:59.185832] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0101-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.188152] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0101-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254944738460, cache_obj->added_lc()=false, cache_obj->get_object_id()=691, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:08:59.205034] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=41] ts response task statistics(alloc_count=2886, free_count=1442) [2025-04-21 14:08:59.205313] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=405, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:59.227963] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=78, stat_interval=5000000, avg (count/cost)=50, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:08:59.228017] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=53] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=78, stat_interval=5000000, avg (count/cost)=1580, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:08:59.228033] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=78, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:08:59.228046] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=11] [APPLY STAT CB EXECUTE TIME](cur_stat_count=78, stat_interval=5000000, avg (count/cost)=-533, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:08:59.228067] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] [APPLY STAT CB TOTAL TIME](cur_stat_count=78, stat_interval=5000000, avg (count/cost)=1098, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:08:59.239613] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215739040465000, v:0}, base_version={val:1745215738840408000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215739040465000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215739239591, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:08:59.241121] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFDA-0-0] [lt=51] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=401, Holding Memory(MB)=68, Tenant Remain Memory(MB)=556, Usable Remain Memory(MB)=333, Last Update Limit Timestamp=1745215739240198, Is Updated=true) [2025-04-21 14:08:59.241168] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFDA-0-0] [lt=44] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035676336288452148e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738454281667255827e+02) [2025-04-21 14:08:59.242845] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] get_max_applied_scn(scn={val:1745215739076701000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26163235}, palf_committed_end_scn_:{val:1745215739241260000, v:0}, last_check_scn_:{val:1745215739241260000, v:0}, max_applied_cb_scn_:{val:1745215739076701000, v:0}}) [2025-04-21 14:08:59.242891] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26163235}, readable_log_tail:{lsn:26163235}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40941533, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:59.249111] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC4-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:08:59.249157] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC4-0-0] [lt=38] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=49) [2025-04-21 14:08:59.258146] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFC-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:08:59.258193] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFC-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:08:59.259953] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.279352] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=90] get_max_applied_scn(scn={val:1745215738703981003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17356447}, palf_committed_end_scn_:{val:1745215738703981004, v:0}, last_check_scn_:{val:1745215738703981004, v:0}, max_applied_cb_scn_:{val:1745215738703981003, v:0}}) [2025-04-21 14:08:59.279411] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17356447}, readable_log_tail:{lsn:17356447}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49748321, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:59.289403] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=51] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:08:59.307538] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:08:59.308795] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE4A-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:59.308857] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE4A-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:59.322901] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:08:59.322960] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:08:59.323134] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:08:59.323311] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:08:59.323394] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:18, schedule:43, submit:9, rt:1402, total:1472) [2025-04-21 14:08:59.323471] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:59.323534] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:18, schedule:43, submit:9, device:1402, total:1472) [2025-04-21 14:08:59.323597] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:08:59.323677] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:568, total:586) [2025-04-21 14:08:59.323755] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:08:59.323793] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:568, total:586) [2025-04-21 14:08:59.323852] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:08:59.323879] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:08:59.336463] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:59.360031] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.361149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:08:59.375208] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:08:59.375258] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.376248] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=96] get_max_applied_scn(scn={val:1745215738703981004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8774300}, palf_committed_end_scn_:{val:1745215739204856000, v:0}, last_check_scn_:{val:1745215739204856000, v:0}, max_applied_cb_scn_:{val:1745215738703981004, v:0}}) [2025-04-21 14:08:59.376311] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=57] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8774300}, readable_log_tail:{lsn:8774300}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58330468, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:59.394920] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:08:59.394977] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:59.395012] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:08:59.395048] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:08:59.395082] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:08:59.396199] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1384, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:08:59.396251] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:08:59.396269] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1441, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:08:59.396306] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:59.396310] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:08:59.396343] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:08:59.396358] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1531, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:08:59.396386] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:08:59.396425] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:08:59.396444] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1539, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:08:59.396463] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:08:59.400024] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:59.400081] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=43] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:59.400109] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=25] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=27) [2025-04-21 14:08:59.400301] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=25] ====== traversal_flush timer task ====== [2025-04-21 14:08:59.400409] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA0-0-0] [lt=29] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215739277625000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:59.400532] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA0-0-0] [lt=116] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:08:59.409642] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=43][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:08:59.420948] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:08:59.426775] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:08:59.432666] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:59.432865] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:59.438336] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:08:59.439286] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:59.439342] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=55] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:08:59.439406] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=36] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:08:59.439487] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=76] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:08:59.439530] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:08:59.439556] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215731434521001, v:0}) [2025-04-21 14:08:59.439575] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:08:59.439594] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:08:59.439614] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:59.439643] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:08:59.439665] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:08:59.439694] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:08:59.439727] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:08:59.439747] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:08:59.441529] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=90] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=10137, avg_group_log_size=533) [2025-04-21 14:08:59.441570] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=10138) [2025-04-21 14:08:59.442618] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1394, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:08:59.442664] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:08:59.442716] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:08:59.442754] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1510, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:08:59.442784] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:08:59.447884] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=91] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:08:59.455795] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:08:59.455850] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.460118] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.475328] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=59] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.475547] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.475612] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.475877] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.479524] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=10136) [2025-04-21 14:08:59.479623] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10136) [2025-04-21 14:08:59.479683] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=20, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1477, avg_log_submit_to_slide_time=1495) [2025-04-21 14:08:59.479759] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10725, hit_cnt=20, read_cnt=20, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:59.496832] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:59.496907] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1483, avg_log_submit_to_slide_time=1503) [2025-04-21 14:08:59.496962] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:08:59.496999] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1538, avg_log_submit_to_slide_time=1546) [2025-04-21 14:08:59.497068] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:59.497111] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:59.517570] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=42] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:08:59.519720] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:08:59.519826] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=82] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3662, avg_group_log_size=332) [2025-04-21 14:08:59.519894] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:08:59.521590] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1421, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:08:59.521648] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3662) [2025-04-21 14:08:59.521708] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:08:59.521782] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:08:59.521824] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1745, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:08:59.521854] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=70, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:08:59.521899] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3662, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:08:59.536944] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:59.546135] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=1200000, clean_num=200000) [2025-04-21 14:08:59.560218] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.561279] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:08:59.577493] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=2, size_used=0, mem_used=4159488) [2025-04-21 14:08:59.577512] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:08:59.577556] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.594778] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=50] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:08:59.595133] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:59.595208] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:08:59.595244] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:08:59.597037] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:08:59.604721] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:59.604769] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:08:59.606537] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:08:59.606575] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:08:59.611111] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC7-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:08:59.621546] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00D9-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.621745] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD1-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.622479] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00DA-0-0] [lt=62][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.623917] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00DD-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.624070] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD2-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.625112] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00DE-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.626901] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:08:59.626938] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=36] try gc retain ctx [2025-04-21 14:08:59.626952] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:08:59.627019] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] finish update min start scn(max_decided_scn={val:1745215739477030000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215729542453001, v:0}, keep_alive_scn_:{val:1745215734614971001, v:0}, update_ts_:1745215739626606}) [2025-04-21 14:08:59.628130] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215747945792000, latest_log_ts:{val:1745215731434521001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:08:59.632634] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=96] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1001, is_allowed_broadcast=true) [2025-04-21 14:08:59.641418] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215739640508000, start_id=1745215739640508000, end_id=1745215739640508001) [2025-04-21 14:08:59.641446] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0C-0-0] [lt=26] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:08:59.641868] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0C-0-0] [lt=62] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215739641840, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:59.641920] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0C-0-0] [lt=50] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215739641361}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215739641840, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:08:59.653222] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=27] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:59.653282] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=25) [2025-04-21 14:08:59.654404] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:59.654455] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:59.654484] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:08:59.654503] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=25) [2025-04-21 14:08:59.660300] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.671930] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4047, offset=70551}, end_cursor:ObLogCursor{file_id=3, log_id=4048, offset=70857}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77508050, len:3177, log_data_len:306, seq:4047, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:59.672280] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE60-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:08:59.672377] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE60-0-0] [lt=64] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215739204856002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215739204856002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:59.675677] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE60-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215739674720000, start_id=1745215739674720000, end_id=1745215739674720001) [2025-04-21 14:08:59.678748] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4048, offset=70857}, end_cursor:ObLogCursor{file_id=3, log_id=4049, offset=71154}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7750c050, len:2871, log_data_len:297, seq:4048, flush_finish:false, flush_ret:0}) [2025-04-21 14:08:59.679023] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE60-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:08:59.679081] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE60-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215739204856002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215739204856002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:08:59.689123] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=38] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:08:59.689182] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=44] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=27) [2025-04-21 14:08:59.692519] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=23] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:08:59.692573] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=40] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:08:59.692600] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=27) [2025-04-21 14:08:59.694652] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.694728] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695147] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695212] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695263] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695394] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695498] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695743] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695851] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.695863] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.696130] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=52] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:08:59.696182] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215739696178, bytes: 4765849, bw: 0.013927 MB/s, add_ts: 1007669, add_bytes: 14716 [2025-04-21 14:08:59.705557] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215739704605000, start_id=1745215739704605000, end_id=1745215739704605001) [2025-04-21 14:08:59.705627] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:08:59.705678] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=424, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:08:59.705707] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215739705659], gts:1745215739704605000, latest_srr:[mts=1745215739705659]}) [2025-04-21 14:08:59.719384] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:08:59.720586] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=46] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:08:59.720683] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215738772378000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:08:59.746624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:59.749125] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65809294}], scn_array=[cnt:1, {val:1745215739704605000, v:0}], curr_size=122, accum_size=706, time_cost=29296) [2025-04-21 14:08:59.760383] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.761433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:08:59.771773] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215739771770, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2025-04-21 14:08:59.775392] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFDFE-0-0] [lt=61][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:08:59.790200] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:08:59.796331] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00E0-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.798889] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00E2-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.814037] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=31] ====== check clog disk timer task ====== [2025-04-21 14:08:59.814087] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:08:59.816300] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00E5-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.816873] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00E6-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:08:59.821178] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:08:59.828504] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:08:59.828557] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:08:59.828574] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:08:59.828599] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:08:59.828622] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254944378717, flush_io_finished_ret_:0, flush_io_finished_round_:131, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:08:59.832911] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:08:59.841875] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:08:59.843538] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215739640508000, v:0}, new_max_version={val:1745215739640508000, v:0}, last_min_version={val:1745215739440746000, v:0}, last_max_version={val:1745215739440746000, v:0}, total_time_us=3412, delta_us=203027) [2025-04-21 14:08:59.843584] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215739640508000, v:0}, min_version={val:1745215739640508000, v:0}, max_version={val:1745215739640508000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:08:59.849907] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=58] ====== tenant freeze timer task ====== [2025-04-21 14:08:59.860470] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.869217] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=33] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65810001}, readable_log_tail:{lsn:65810001}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1294767, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:08:59.869348] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=130] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:08:59.869393] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:08:59.875356] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:08:59.875408] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.879820] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=14, gc_interval=10000000) [2025-04-21 14:08:59.879894] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=39] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:08:59.879922] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] gc_check_member_list_ cost time(ret=0, time_us=62) [2025-04-21 14:08:59.879943] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=14] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:08:59.879963] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:08:59.879983] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=14] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:08:59.880005] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=24) [2025-04-21 14:08:59.880024] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyHandler start process [2025-04-21 14:08:59.891570] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE52-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:08:59.891636] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE52-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:08:59.892123] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=48] finish to resize log external storage handler(current_ts=1745215739892118, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:08:59.905776] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:08:59.905816] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=36] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:59.905835] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:08:59.905851] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:59.909142] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] Dumping All Cache Objs(alloc_obj_list.count()=328, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}]) [2025-04-21 14:08:59.909857] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=712] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:08:59.916336] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=46] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:08:59.921400] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3533) [2025-04-21 14:08:59.921470] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=4361, avg_log_submit_to_slide_time=4384) [2025-04-21 14:08:59.924597] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=42] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:08:59.947148] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:08:59.956011] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:08:59.956071] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:08:59.958778] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=43] current monitor number(seq_=-1) [2025-04-21 14:08:59.960546] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:08:59.961578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:08:59.965767] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=41] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14638, max_lsn:65810123, max_scn:{val:1745215739774645001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65810123}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65810001}, last_submit_end_lsn:{lsn:65810123}, last_submit_log_id:14638, last_submit_log_pid:3, max_flushed_lsn:{lsn:65810001}, max_flushed_end_lsn:{lsn:65810123}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65810123}, last_slide_log_id:14638, last_slide_scn:{val:1745215739774645001, v:0}, last_slide_lsn:{lsn:65810001}, last_slide_end_lsn:{lsn:65810123}, last_slide_log_pid:3, last_slide_log_accum_checksum:3179964692, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14639, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65810123}, readable_log_tail:{lsn:65810123}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1294645, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:08:59.966042] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=265] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215739921391, last_flushed_end_lsn:{lsn:65810123}}]) [2025-04-21 14:08:59.966069] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14639, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215739921391, last_flushed_end_lsn:{lsn:65810123}}]) [2025-04-21 14:08:59.984164] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:08:59.988118] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=100] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:00.036505] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:00.060636] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.065831] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=367) [2025-04-21 14:09:00.081302] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:00.081375] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.085041] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=33] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:00.102978] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=84] BlockGCTimerTask success(ret=0, cost_time_us=16, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:00.120131] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3533) [2025-04-21 14:09:00.147669] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:00.160704] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.166656] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6400000, replace_num=100000) [2025-04-21 14:09:00.166713] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:00.191962] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0103-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.194494] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0103-0-0] [lt=40][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254945744800, cache_obj->added_lc()=false, cache_obj->get_object_id()=692, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:00.206190] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=37] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215740206158], gts:1745215740205586000, latest_srr:[mts=1745215740206158]}) [2025-04-21 14:09:00.240431] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215740041686000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198728, in_cluster_service=true, cluster_version={val:1745215739840764000, v:0}, min_cluster_version={val:1745215739840764000, v:0}, max_cluster_version={val:1745215739840764000, v:0}, get_cluster_version_err=0, cluster_version_delta=399650, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1170, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=75061007, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:00.241933] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFDF-0-0] [lt=95] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035676336288452148e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.738454281667255827e+02) [2025-04-21 14:09:00.244121] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:00.260056] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFD-0-0] [lt=26] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:00.260117] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFD-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:00.260781] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.310767] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE4B-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:00.310846] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE4B-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:00.324926] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:00.325021] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:00.325219] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:00.325408] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:00.325495] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:43, submit:9, rt:1420, total:1489) [2025-04-21 14:09:00.325576] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:00.325644] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:17, schedule:43, submit:9, device:1420, total:1489) [2025-04-21 14:09:00.325706] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:00.325783] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:535, total:549) [2025-04-21 14:09:00.325864] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:00.325901] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:535, total:549) [2025-04-21 14:09:00.325962] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:00.325988] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:00.348163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:00.360868] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.366851] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:00.375524] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:00.377482] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1745215740375100000, start_id=1745215740375100000, end_id=1745215740375100001) [2025-04-21 14:09:00.379053] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:00.379114] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.397386] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:00.397487] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=83] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:00.397525] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:00.397593] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:00.397636] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:00.399330] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2125, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:00.399397] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:00.399444] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:00.399428] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1547, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:00.399474] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=108, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:00.399501] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:00.399551] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2248, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:00.399592] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:00.399636] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:00.399657] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1778, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:00.399678] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:00.404084] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:00.404169] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=73] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:09:00.409040] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:09:00.421046] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:00.427876] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:00.432831] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:00.432946] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=101] temporary file module use no blocks [2025-04-21 14:09:00.432973] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:00.433041] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=62] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:00.433068] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:00.433084] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254944983036, flush_io_finished_ret_:0, flush_io_finished_round_:132, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:00.442554] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8374, avg_group_log_size=492) [2025-04-21 14:09:00.442606] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8373) [2025-04-21 14:09:00.444351] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1557, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:00.444448] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=156, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:00.444518] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:00.444570] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1820, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:00.444607] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:00.456196] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:00.456254] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.460945] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.475437] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.475732] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.475913] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.476019] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.476489] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=82] new mysql sessid created(conn.sessid_=3221487801, support_ssl=false) [2025-04-21 14:09:00.476581] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=45] sm conn init succ(conn.sessid_=3221487801, sess.client_addr_="11.29.122.182:43944") [2025-04-21 14:09:00.476617] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] accept one succ(*s={this:0x7f3bc7c04d70, session_id:3221487801, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:192}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.477041] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1002][Y0-0000000000000000-0-0] [lt=39] succeed to dispatch to tenant mysql queue(tenant_id=1002) [2025-04-21 14:09:00.478638] INFO [SERVER] process (obmp_connect.cpp:523) [620294][T1002_MysqlQueu][T1002][Y0-00063343B75EFDCC-0-0] [lt=53] MySQL LOGIN(direct_client_ip="11.29.122.182", client_ip=11.29.122.182, tenant_name=ocp_meta, tenant_id=1002, user_name=meta, host_name=%, sessid=3221487801, proxy_sessid=0, client_sessid=3221487801, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=true, capability=683647754, proxy_capability=1480, use_ssl=false, c/s protocol="OB_2_0_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:00.479507] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD3-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.479643] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD3-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.479785] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD3-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.479875] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD3-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.481862] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c04d70, session_id:3221487801, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215740481275, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1108, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.481964] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=52] kill and revert session(conn.sessid_=3221487801, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:00.481992] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=27] sock ref clean, do destroy(*s={this:0x7f3bc7c04d70, session_id:3221487801, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:192}, err:5, last_decode_time:1745215740481275, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1108, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.482032] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] unlock session of tenant(conn.sessid_=3221487801, proxy_sessid=0, conn.tenant_id_=1002) [2025-04-21 14:09:00.482086] INFO [SERVER] run (obmp_disconnect.cpp:82) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=28] free session successfully(sessid=3221487801) [2025-04-21 14:09:00.482126] INFO [SERVER] run (obmp_disconnect.cpp:89) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=38] mark session id unused(sessid=3221487801) [2025-04-21 14:09:00.482059] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487801, proxy_sessid=0, tenant_id=1002, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_2_0_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B76F00EA-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:16, cur_pkt_pos_:19, pkt_rec[0]:{send:obp_mysql_header_{len_:170, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{send:obp20_header_:{payload_len:127, pkt_seq:0, req_id:6778336, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[2]:{send:obp20_header_:{payload_len:19, pkt_seq:0, req_id:6778337, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:126, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{receive:obp20_header_:{payload_len:160, pkt_seq:0, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, rec_:160, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[4]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[8]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:6778338, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[9]:{receive:obp20_header_:{payload_len:62, pkt_seq:0, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:58, rec_:62, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[10]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[11]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[12]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[13]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[14]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:6778339, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[15]:{receive:obp20_header_:{payload_len:170, pkt_seq:0, req_id:6778340, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:166, rec_:170, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[16]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:6778340, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[17]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:6778340, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[18]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:6778340, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:00.482841] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8375) [2025-04-21 14:09:00.482939] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8375) [2025-04-21 14:09:00.483004] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1794, avg_log_submit_to_slide_time=1815) [2025-04-21 14:09:00.483129] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8375, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:00.485607] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=45] new mysql sessid created(conn.sessid_=3221487802, support_ssl=false) [2025-04-21 14:09:00.485699] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] sm conn init succ(conn.sessid_=3221487802, sess.client_addr_="11.29.122.182:43952") [2025-04-21 14:09:00.485723] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3bc7c1a030, session_id:3221487802, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.485991] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1002][Y0-0000000000000000-0-0] [lt=24] succeed to dispatch to tenant mysql queue(tenant_id=1002) [2025-04-21 14:09:00.486323] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=73] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1002, avail_memory=53687091, chunk_count_=0, avail_sort_memory_=53687091, avail_memory_=53687091) [2025-04-21 14:09:00.487435] INFO [SERVER] process (obmp_connect.cpp:523) [620294][T1002_MysqlQueu][T1002][Y0-00063343B75EFDCD-0-0] [lt=100] MySQL LOGIN(direct_client_ip="11.29.122.182", client_ip=11.29.122.182, tenant_name=ocp_meta, tenant_id=1002, user_name=meta, host_name=%, sessid=3221487802, proxy_sessid=0, client_sessid=3221487802, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=true, capability=683647754, proxy_capability=1480, use_ssl=false, c/s protocol="OB_2_0_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:00.488044] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00EB-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.488154] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00EB-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.488274] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00EB-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.488332] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00EB-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.489910] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1a030, session_id:3221487802, trace_id:YB420B1D7AB6-00063343B76F00F0-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215740488545, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1116, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.489935] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=19][errcode=0] server close connection(sessid=3221487802, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:00.489968] INFO [SERVER] process (obmp_quit.h:56) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=30] quit [2025-04-21 14:09:00.489974] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=53] kill and revert session(conn.sessid_=3221487802, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:00.489985] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:00.490002] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=15][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:00.490014] WDIAG [SERVER] response (obmp_base.cpp:87) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=12][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:00.490026] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=10][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:00.490041] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.490061] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F0-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.490094] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.491451] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=43] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:09:00.491514] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=57] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:09:00.493513] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=71] new mysql sessid created(conn.sessid_=3221487803, support_ssl=false) [2025-04-21 14:09:00.493609] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487803, sess.client_addr_="11.29.122.182:43962") [2025-04-21 14:09:00.493642] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487803, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.493847] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1002][Y0-0000000000000000-0-0] [lt=27] succeed to dispatch to tenant mysql queue(tenant_id=1002) [2025-04-21 14:09:00.495175] INFO [SERVER] process (obmp_connect.cpp:523) [620294][T1002_MysqlQueu][T1002][Y0-00063343B75EFDCE-0-0] [lt=88] MySQL LOGIN(direct_client_ip="11.29.122.182", client_ip=11.29.122.182, tenant_name=ocp_meta, tenant_id=1002, user_name=meta, host_name=%, sessid=3221487803, proxy_sessid=0, client_sessid=3221487803, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=true, capability=683647754, proxy_capability=1480, use_ssl=false, c/s protocol="OB_2_0_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:00.495669] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F1-0-0] [lt=18][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.495755] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F1-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.495864] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F1-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.495918] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F1-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.497401] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=24][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487803, trace_id:YB420B1D7AB6-00063343B76F00F6-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215740496400, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1106, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.497427] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=15][errcode=0] server close connection(sessid=3221487803, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:00.497445] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=36] kill and revert session(conn.sessid_=3221487803, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:00.497457] INFO [SERVER] process (obmp_quit.h:56) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=27] quit [2025-04-21 14:09:00.497475] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=17][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:00.497494] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:00.497510] WDIAG [SERVER] response (obmp_base.cpp:87) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=15][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:00.497526] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=15][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:00.497545] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.497562] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F6-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.497578] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:00.498898] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:00.498970] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1689, avg_log_submit_to_slide_time=1709) [2025-04-21 14:09:00.499025] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:00.499060] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=2185, avg_log_submit_to_slide_time=2200) [2025-04-21 14:09:00.499108] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:00.499148] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:00.501294] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=138] new mysql sessid created(conn.sessid_=3221487804, support_ssl=false) [2025-04-21 14:09:00.501373] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=41] sm conn init succ(conn.sessid_=3221487804, sess.client_addr_="11.29.122.182:43974") [2025-04-21 14:09:00.501407] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] accept one succ(*s={this:0x7f3bc7c1ad70, session_id:3221487804, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.501754] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1002][Y0-0000000000000000-0-0] [lt=31] succeed to dispatch to tenant mysql queue(tenant_id=1002) [2025-04-21 14:09:00.503187] INFO [SERVER] process (obmp_connect.cpp:523) [620294][T1002_MysqlQueu][T1002][Y0-00063343B75EFDCF-0-0] [lt=64] MySQL LOGIN(direct_client_ip="11.29.122.182", client_ip=11.29.122.182, tenant_name=ocp_meta, tenant_id=1002, user_name=meta, host_name=%, sessid=3221487804, proxy_sessid=0, client_sessid=3221487804, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=true, capability=683647754, proxy_capability=1480, use_ssl=false, c/s protocol="OB_2_0_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:00.504001] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F7-0-0] [lt=15][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.504110] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F7-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.504238] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F7-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.504301] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00F7-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.506247] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1ad70, session_id:3221487804, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215740505145, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1114, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.506330] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=69] kill and revert session(conn.sessid_=3221487804, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:00.506366] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] sock ref clean, do destroy(*s={this:0x7f3bc7c1ad70, session_id:3221487804, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215740505145, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1114, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:00.506417] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] unlock session of tenant(conn.sessid_=3221487804, proxy_sessid=0, conn.tenant_id_=1002) [2025-04-21 14:09:00.506571] INFO [SERVER] run (obmp_disconnect.cpp:82) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=25] free session successfully(sessid=3221487804) [2025-04-21 14:09:00.506611] INFO [SERVER] run (obmp_disconnect.cpp:89) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=38] mark session id unused(sessid=3221487804) [2025-04-21 14:09:00.506450] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] connection close(sessid=3221487804, proxy_sessid=0, tenant_id=1002, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_2_0_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B76F00FB-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:16, cur_pkt_pos_:19, pkt_rec[0]:{send:obp_mysql_header_{len_:170, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{send:obp20_header_:{payload_len:127, pkt_seq:0, req_id:457454, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[2]:{send:obp20_header_:{payload_len:19, pkt_seq:0, req_id:457455, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:126, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{receive:obp20_header_:{payload_len:160, pkt_seq:0, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, rec_:160, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[4]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[8]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:457456, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[9]:{receive:obp20_header_:{payload_len:62, pkt_seq:0, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:58, rec_:62, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[10]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[11]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[12]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[13]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[14]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:457457, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[15]:{receive:obp20_header_:{payload_len:176, pkt_seq:0, req_id:457458, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:172, rec_:176, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[16]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:457458, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[17]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:457458, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[18]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:457458, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:00.512906] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3bc7c1a030, session_id:3221487802, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:205}, err:5, last_decode_time:1745215740488545, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1156, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:00.512983] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=60] unlock session of tenant(conn.sessid_=3221487802, proxy_sessid=0, conn.tenant_id_=1002) [2025-04-21 14:09:00.513022] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] connection close(sessid=3221487802, proxy_sessid=0, tenant_id=1002, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_2_0_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B76F00EF-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:16, cur_pkt_pos_:20, pkt_rec[0]:{send:obp_mysql_header_{len_:170, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{send:obp20_header_:{payload_len:127, pkt_seq:0, req_id:2427202, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[2]:{send:obp20_header_:{payload_len:19, pkt_seq:0, req_id:2427203, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:126, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{receive:obp20_header_:{payload_len:160, pkt_seq:0, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, rec_:160, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[4]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[8]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:2427204, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[9]:{receive:obp20_header_:{payload_len:62, pkt_seq:0, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:58, rec_:62, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[10]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[11]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[12]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[13]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[14]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:2427205, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[15]:{receive:obp20_header_:{payload_len:178, pkt_seq:0, req_id:2427206, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:174, rec_:178, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[16]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:2427206, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[17]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:2427206, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[18]:{send:obp_compess_header_{com_len:156, com_seq:1}, obp20_header_:{payload_len:128, pkt_seq:1, req_id:2427206, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[19]:{receive:obp20_header_:{payload_len:5, pkt_seq:0, req_id:2427207, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:1, rec_:5, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:00.513267] INFO [SERVER] run (obmp_disconnect.cpp:82) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487802) [2025-04-21 14:09:00.513303] INFO [SERVER] run (obmp_disconnect.cpp:89) [620345][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487802) [2025-04-21 14:09:00.520954] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:00.521051] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=78] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4078, avg_group_log_size=370) [2025-04-21 14:09:00.521083] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:00.522677] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=96] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4069, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:00.522741] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4078) [2025-04-21 14:09:00.522775] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:00.522833] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:00.522881] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4316, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:00.522909] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=60, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:00.523006] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4078, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:00.548719] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:00.561029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=93][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.569660] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:09:00.569741] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=66] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:00.570600] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:00.580079] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:00.581528] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:00.581594] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.583630] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:00.583724] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=83] temporary file module use no blocks [2025-04-21 14:09:00.583758] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=30] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:00.583795] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:00.583829] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=32] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254945133834, flush_io_finished_ret_:0, flush_io_finished_round_:132, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:00.596311] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=63] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:00.603713] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:00.603809] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:00.603844] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:00.605193] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:00.605240] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:00.605560] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2025-04-21 14:09:00.605627] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=53] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62315720, tenant_id=1002) [2025-04-21 14:09:00.605694] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=44] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:00.605829] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:00.608593] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:00.608629] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:00.625539] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00FD-0-0] [lt=14][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.625780] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] can close safely, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487803, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215740496400, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1146, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:00.625906] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=104] unlock session of tenant(conn.sessid_=3221487803, proxy_sessid=0, conn.tenant_id_=1002) [2025-04-21 14:09:00.625942] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F00FE-0-0] [lt=63][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.625977] INFO [SERVER] run (obmp_disconnect.cpp:82) [620347][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=60] free session successfully(sessid=3221487803) [2025-04-21 14:09:00.626021] INFO [SERVER] run (obmp_disconnect.cpp:89) [620347][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=42] mark session id unused(sessid=3221487803) [2025-04-21 14:09:00.625948] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] connection close(sessid=3221487803, proxy_sessid=0, tenant_id=1002, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_2_0_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B76F00F5-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:16, cur_pkt_pos_:22, pkt_rec[0]:{send:obp_mysql_header_{len_:170, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{send:obp20_header_:{payload_len:127, pkt_seq:0, req_id:7513701, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[2]:{send:obp20_header_:{payload_len:19, pkt_seq:0, req_id:7513702, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:126, seq_:2}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{receive:obp20_header_:{payload_len:160, pkt_seq:0, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:156, rec_:160, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[4]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[8]:{send:obp_compess_header_{com_len:352, com_seq:1}, obp20_header_:{payload_len:324, pkt_seq:1, req_id:7513703, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[9]:{receive:obp20_header_:{payload_len:62, pkt_seq:0, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:58, rec_:62, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[10]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[11]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[12]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[13]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[14]:{send:obp_compess_header_{com_len:321, com_seq:1}, obp20_header_:{payload_len:293, pkt_seq:1, req_id:7513704, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[15]:{receive:obp20_header_:{payload_len:168, pkt_seq:0, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:164, rec_:168, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[16]:{send:obp_compess_header_{com_len:4393, com_seq:1}, obp20_header_:{payload_len:4365, pkt_seq:1, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[17]:{send:obp_compess_header_{com_len:4393, com_seq:1}, obp20_header_:{payload_len:4365, pkt_seq:1, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[18]:{send:obp_compess_header_{com_len:4393, com_seq:1}, obp20_header_:{payload_len:4365, pkt_seq:1, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[19]:{send:obp_compess_header_{com_len:4393, com_seq:1}, obp20_header_:{payload_len:4365, pkt_seq:1, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{pkt_num_:58, seq_:63}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[20]:{send:obp_compess_header_{com_len:4393, com_seq:1}, obp20_header_:{payload_len:4365, pkt_seq:1, req_id:7513705, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:9, seq_:64}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[21]:{receive:obp20_header_:{payload_len:5, pkt_seq:0, req_id:7513706, flag_.flags:2, ext_flags:0}, obp_mysql_header_{len_:1, rec_:5, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:00.627689] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0100-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.628427] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0101-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.635338] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0104-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.637838] WDIAG begin (ob_hashtable.h:954) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8B-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.640564] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8B-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254946190812, cache_obj->added_lc()=false, cache_obj->get_object_id()=693, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:00.646620] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0107-0-0] [lt=43][errcode=-4201] hashtable not init [2025-04-21 14:09:00.646713] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0107-0-0] [lt=90] get cursor info failed(cursor_id=41, get_sessid()=3221487630) [2025-04-21 14:09:00.646939] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215740643438000, start_id=1745215740643438000, end_id=1745215740643438001) [2025-04-21 14:09:00.650155] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0105-0-0] [lt=65][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.651395] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=86] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:00.656636] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=83] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:00.661123] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.685344] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4049, offset=71154}, end_cursor:ObLogCursor{file_id=3, log_id=4050, offset=71460}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77510050, len:2574, log_data_len:306, seq:4049, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:00.685772] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE61-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:00.685940] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE61-0-0] [lt=111] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215740205586002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215740205586002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:00.691695] INFO pn_print_diag_info (group.c:724) [619531][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO client:0x7f3c7e86e048_"11.29.122.182:2882"_"11.29.122.182:2882"_141_1745215602584305_1, write_queue=0/0, write=1070/1009965, read=1070/267939, doing=0, done=1070, write_time=4188304, read_time=623, process_time=1148 [2025-04-21 14:09:00.691764] INFO pn_print_diag_info (group.c:736) [619531][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO server:0x7f3c7e86ea98_"11.29.122.182:53238"_142_1745215602586353, write_queue=0/0, write=1070/267939, read=1070/1009965, doing=0, done=1070, write_time=4171090, read_time=683, process_time=1215 [2025-04-21 14:09:00.691790] INFO pn_print_diag_info (group.c:743) [619531][pnio1][T0][Y0-0000000000000000-0-0] [lt=24] PNIO client_send:1070/1009965, client_queue_time=76000, cnt=1, server_send:1070/267939, server_queue_time=68000, cnt=1 [2025-04-21 14:09:00.695017] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695307] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695317] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695389] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695448] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.695958] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.696340] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.696275] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.696418] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.696564] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:00.703866] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=33] PNIO [ratelimit] time: 1745215740703856, bytes: 4778097, bw: 0.011592 MB/s, add_ts: 1007678, add_bytes: 12248 [2025-04-21 14:09:00.703981] INFO pn_print_diag_info (group.c:724) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=107] PNIO client:0x7f3c7e804808_"11.29.122.182:2882"_"11.29.122.182:2882"_132_1745215599757940_1, write_queue=0/0, write=1070/875930, read=1070/267016, doing=0, done=1070, write_time=4182365, read_time=595, process_time=1136 [2025-04-21 14:09:00.704013] INFO pn_print_diag_info (group.c:736) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=29] PNIO server:0x7f3c7e805258_"11.29.122.182:53214"_133_1745215599759260, write_queue=0/0, write=1070/267016, read=1070/875930, doing=0, done=1070, write_time=4173109, read_time=736, process_time=1257 [2025-04-21 14:09:00.704038] INFO pn_print_diag_info (group.c:743) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=23] PNIO client_send:1070/875930, client_queue_time=124000, cnt=1, server_send:1070/267016, server_queue_time=80000, cnt=1 [2025-04-21 14:09:00.709224] INFO pn_print_diag_info (group.c:724) [619532][pnio1][T0][Y0-0000000000000000-0-0] [lt=12] PNIO client:0x7f3c7e86f4a8_"11.29.122.182:2882"_"11.29.122.182:2882"_137_1745215602792159_1, write_queue=0/0, write=1070/859349, read=1070/269309, doing=0, done=1070, write_time=4219442, read_time=640, process_time=1189 [2025-04-21 14:09:00.709318] INFO pn_print_diag_info (group.c:736) [619532][pnio1][T0][Y0-0000000000000000-0-0] [lt=88] PNIO server:0x7f3c7e8ee048_"11.29.122.182:53252"_143_1745215602793801, write_queue=0/0, write=1070/269309, read=1070/859349, doing=0, done=1070, write_time=4218363, read_time=653, process_time=1288 [2025-04-21 14:09:00.709344] INFO pn_print_diag_info (group.c:743) [619532][pnio1][T0][Y0-0000000000000000-0-0] [lt=26] PNIO client_send:1070/859349, client_queue_time=104000, cnt=1, server_send:1070/269309, server_queue_time=60000, cnt=1 [2025-04-21 14:09:00.714132] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDF3-0-0] [lt=25] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:00.720939] INFO pn_print_diag_info (group.c:724) [619533][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO client:0x7f3c7e8eea58_"11.29.122.182:2882"_"11.29.122.182:2882"_144_1745215603798355_1, write_queue=0/0, write=1069/961711, read=1069/266878, doing=0, done=1069, write_time=4156260, read_time=625, process_time=1251 [2025-04-21 14:09:00.721040] INFO pn_print_diag_info (group.c:736) [619533][pnio1][T0][Y0-0000000000000000-0-0] [lt=98] PNIO server:0x7f3c7e8ef4a8_"11.29.122.182:53254"_145_1745215603799693, write_queue=0/0, write=1069/266878, read=1069/961711, doing=0, done=1069, write_time=4127952, read_time=652, process_time=1254 [2025-04-21 14:09:00.721060] INFO pn_print_diag_info (group.c:743) [619533][pnio1][T0][Y0-0000000000000000-0-0] [lt=20] PNIO client_send:1069/961711, client_queue_time=76000, cnt=1, server_send:1069/266878, server_queue_time=72000, cnt=1 [2025-04-21 14:09:00.731217] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=54] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:00.746521] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDEF-0-0] [lt=47] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:00.746722] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDF1-0-0] [lt=73] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:00.749455] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=77] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:00.760164] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17362251, this={dio_aligned_buf:{buf_write_offset:3525, buf_padding_size:571, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:2817, truncate_used_ts:1068}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17358848, buf_len=122, total_write_size=13597, total_write_size_after_dio=417792, ob_pwrite_used_ts=203789, count=99, each_pwrite_cost=2058) [2025-04-21 14:09:00.760261] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=82][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17358155}], scn_array=[cnt:1, {val:1745215740205586004, v:0}], curr_size=122, accum_size=122, time_cost=55540) [2025-04-21 14:09:00.760282] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8775886}], scn_array=[cnt:1, {val:1745215740205586004, v:0}], curr_size=122, accum_size=366, time_cost=55514) [2025-04-21 14:09:00.761070] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=63] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:00.761418] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:00.761464] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:00.761496] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.763994] INFO [STORAGE.REDO] write_logs (ob_storage_log_writer.cpp:512) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=92] Slow write(duration=54512, write_len=4096) [2025-04-21 14:09:00.764055] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4050, offset=71460}, end_cursor:ObLogCursor{file_id=3, log_id=4051, offset=71757}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77514050, len:2268, log_data_len:297, seq:4050, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:00.764358] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE61-0-0] [lt=65] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:00.764441] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624858][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE61-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215740205586003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215740205586003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:00.771804] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:00.779209] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=117] get number(ret=0, service_type_=0, range=1, base_id=1745215740779078000, start_id=1745215740779078000, end_id=1745215740779078001) [2025-04-21 14:09:00.779473] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215740779468, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007698, add_bytes: 0 [2025-04-21 14:09:00.779516] INFO pn_print_diag_info (group.c:743) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO client_send:0/0, client_queue_time=0, cnt=0, server_send:0/0, server_queue_time=0, cnt=0 [2025-04-21 14:09:00.790602] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=37] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:00.801219] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0107-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.808798] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD4-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.824414] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=33] gc stale ls task succ [2025-04-21 14:09:00.825284] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010A-0-0] [lt=63][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.826380] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010B-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.833129] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=63] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:00.843917] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:00.847316] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=78] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215740642326000, v:0}, new_max_version={val:1745215740642326000, v:0}, last_min_version={val:1745215740442296000, v:0}, last_max_version={val:1745215740442296000, v:0}, total_time_us=6207, delta_us=204985) [2025-04-21 14:09:00.847417] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215740642326000, v:0}, min_version={val:1745215740642326000, v:0}, max_version={val:1745215740642326000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:00.861440] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.879394] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:00.879503] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=98] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.893549] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE53-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:00.893631] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE53-0-0] [lt=79] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:00.908139] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010C-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.908711] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDDA-0-0] [lt=46] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:00.908937] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010D-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.910492] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010E-0-0] [lt=33][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=9, len=222, pos=202, bitmap=NULL) [2025-04-21 14:09:00.914673] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F010F-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.915294] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=45] start to print blacklist info [2025-04-21 14:09:00.915396] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0110-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:00.915486] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=33] ls blacklist refresh finish(cost_time=10004) [2025-04-21 14:09:00.925286] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4516) [2025-04-21 14:09:00.925406] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=91] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=87, avg_log_gen_to_submit_time=115, avg_log_submit_to_flush_time=1885, avg_log_submit_to_slide_time=1920) [2025-04-21 14:09:00.938374] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDF5-0-0] [lt=43] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:00.953405] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:00.953714] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash time detail, (compute_wash_size_time=188, refresh_score_time=54, wash_time=0) [2025-04-21 14:09:00.956409] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:00.956487] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:00.957358] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=34] LogLoopThread round_cost_time(us)(round_cost_time=32) [2025-04-21 14:09:00.961511] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=89][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:00.971956] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:01.018605] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=22] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:01.018655] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBD-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:01.018665] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=60] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:01.018716] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBD-0-0] [lt=54] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:01.028440] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=17] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:01.028624] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=82] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:01.036680] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=75] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:01.039228] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=27] === Run print tenant memory usage task === [2025-04-21 14:09:01.039323] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=42] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 135,151,616 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,741,039,171 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,076,969,472 max_mem_memstore_can_get_now= 2,458,828,800 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,741,039,171 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 72,144,060 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 547,336,192 max_mem_memstore_can_get_now= 360,720,366 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,741,039,171 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,525,420 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 649,814,016 max_mem_memstore_can_get_now= 312,627,164 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:01.039442] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=25] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,182,452,736 total_hold= 3,353,346,048 used= 3,117,236,224 freelists_hold= 65,216,512 total_maps= 1,204 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,868,381,184 divisive_memory_used= 135,151,616 virtual_memory_used= 4,557,848,576 [CHUNK_MGR] 2 MB_CACHE: hold= 16,777,216 free= 8 pushes= 322,853 pops= 322,845 maps= 1,070 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 129 pops= 127 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:01.039505] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=29] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:01.054603] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:01.054772] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=101] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:01.054808] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=216, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:01.054894] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=651911168, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=421830656, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:01.054970] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:01.054993] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=26, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:01.054987] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE4C-0-0] [lt=18] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.059006] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=39] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745300471149799, last_date_:0, this_date_:0, next_date_:1745300471149799, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:01.059129] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=122] check all tenants(ret=0) [2025-04-21 14:09:01.061322] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE50-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.061337] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD92-0-0] [lt=52] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:01.061405] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] [COMPACTION DAG STATUS] (start_time=1745215731058696, end_time=1745215741061402, dag_status={}) [2025-04-21 14:09:01.061433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061453] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061467] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061480] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061492] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061505] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061517] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061530] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061542] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:01.061556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061575] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061590] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061604] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061631] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061604] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.061645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061673] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061687] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061701] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061729] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061770] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061797] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061812] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061825] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061894] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061921] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061935] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061961] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.061988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062001] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062042] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062068] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062095] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062122] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062136] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062163] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062176] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062202] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062228] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062255] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062268] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062281] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062294] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062308] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062321] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062364] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062391] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062405] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062418] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062461] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062502] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:01.062516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:01.062529] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:01.062543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:01.062554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:01.062565] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:01.062587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:01.062600] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:01.062634] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE51-0-0] [lt=33] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.062612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:01.062734] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=122] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:01.062746] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:01.062759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:01.063919] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE52-0-0] [lt=22] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.064240] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:01.065237] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE53-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.066530] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE54-0-0] [lt=33] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.067898] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE55-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.069302] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE56-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.081694] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:01.081773] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.119732] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] success to update min reserved snapshot(reserved_snapshot=1745213931182505000, duration=1800, snapshot_gc_ts=1745215731182505000) [2025-04-21 14:09:01.120259] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:01.120340] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=74] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:01.120385] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=41] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:01.120422] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=34] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:01.121491] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4516) [2025-04-21 14:09:01.123157] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=39] [APPLY STAT CB APPEND COST TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=60, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:01.123202] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=44] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=2369, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:01.123217] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:01.123239] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=-453, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:01.123252] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0108-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=52, stat_interval=5000000, avg (count/cost)=1976, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:01.124293] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=63] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:09:01.124756] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=457] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:01.124912] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=64] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213931182505000) [2025-04-21 14:09:01.126728] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=111] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8780592, this={dio_aligned_buf:{buf_write_offset:2976, buf_padding_size:1120, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3302, truncate_used_ts:1369}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8777728, buf_len=112, total_write_size=13171, total_write_size_after_dio=413696, ob_pwrite_used_ts=207614, count=98, each_pwrite_cost=2118) [2025-04-21 14:09:01.127137] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1745213931182505000) [2025-04-21 14:09:01.127166] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=27] update reserved snapshot finished(cost_ts=7451, reserved_snapshot=1745213931182505000) [2025-04-21 14:09:01.132760] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=33] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:01.134652] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFDA0-0-0] [lt=42] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=118) [2025-04-21 14:09:01.134941] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] get number(ret=0, service_type_=0, range=1, base_id=1745215741134420000, start_id=1745215741134420000, end_id=1745215741134420001) [2025-04-21 14:09:01.154229] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=30] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:01.161690] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.172151] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=38] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:01.172134] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=89] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:01.173555] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=49] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:01.173603] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=44] no transfer partition job [2025-04-21 14:09:01.173623] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=16] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:01.176227] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=25] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:01.176302] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=56] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:01.176352] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD92-0-0] [lt=41] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:01.198709] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0109-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.201454] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0109-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254946751761, cache_obj->added_lc()=false, cache_obj->get_object_id()=694, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:01.207370] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:01.249789] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC5-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:01.249859] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC5-0-0] [lt=62] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=72) [2025-04-21 14:09:01.261773] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.262085] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFE-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:01.262136] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFE-0-0] [lt=49] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:01.283205] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=101] submit log success(service_type_=0, last_id=1745215757945792000, limited_id=1745215757945792000) [2025-04-21 14:09:01.283259] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] submit log with lock success(service_type_=0, last_id=1745215757945792000, limited_id=1745215757945792000) [2025-04-21 14:09:01.283276] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] get number(ret=0, service_type_=0, range=1, base_id=1745215741282879000, start_id=1745215741282879000, end_id=1745215741282879001) [2025-04-21 14:09:01.285227] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] update id meta(ret=0, service_type=0, limited_id=1745215757945792000, latest_scn={val:1745215741282879001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:01.285375] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=146] handle submit callback(service_type_=0, success=true, used_ts=2173, log_ts={val:1745215741282879001, v:0}, limited_id=1745215757945792000) [2025-04-21 14:09:01.285402] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=25] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:01.285419] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:01.286504] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215741286104000, start_id=1745215741286104000, end_id=1745215741286104001) [2025-04-21 14:09:01.312622] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE57-0-0] [lt=35] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:01.312702] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE57-0-0] [lt=77] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.317450] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=73] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:01.321142] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:522) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=19] worker thread began to shrink(tenant_->id()=1002, group_id_=18, token=0) [2025-04-21 14:09:01.326922] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:534) [624858][T1002_L0_G18][T1002][Y0-0000000000000000-0-0] [lt=50] worker thread exit(tenant_->id()=1002, workers_.get_size()=1) [2025-04-21 14:09:01.326986] INFO [SHARE] end_run (ob_tenant_base.cpp:334) [624858][T1002_L0_G18][T0][Y0-0000000000000000-0-0] [lt=46] tenant thread end_run(id_=1002, ret=0, thread_count_=149) [2025-04-21 14:09:01.333641] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:01.333726] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:01.333975] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:01.334225] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:01.334338] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8120, [delay/us]:prepare:28, schedule:59, submit:12, rt:28024, total:28124) [2025-04-21 14:09:01.334431] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:01.334537] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=94] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8119, [delay/us]: prepare:28, schedule:59, submit:12, device:28024, total:28124) [2025-04-21 14:09:01.334621] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:01.334747] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4059, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:619, total:648) [2025-04-21 14:09:01.334858] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:01.334931] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4059, [delay/us]: prepare:0, schedule:0, submit:600000000, device:619, total:648) [2025-04-21 14:09:01.335016] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:01.335060] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:01.354733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:01.361860] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.372288] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:01.372348] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=13] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:01.373564] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=33] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:01.373664] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215741191562000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:01.379628] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:01.379722] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=86] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.405954] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:01.406034] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2448, avg_group_log_size=222) [2025-04-21 14:09:01.406066] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:01.406102] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:01.406135] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:01.407394] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=143] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7012, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:01.407459] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1210) [2025-04-21 14:09:01.407454] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6647, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:01.407503] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=330, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:01.407500] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:01.407576] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:01.407618] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7542, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:01.407643] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:01.407675] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:01.407695] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6913, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:01.407715] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:01.421113] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:09:01.428770] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:01.433243] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:01.443187] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFE5-0-0] [lt=33] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035827684402465820e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.737949763019373677e+02) [2025-04-21 14:09:01.443496] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8783, avg_group_log_size=516) [2025-04-21 14:09:01.443541] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8783) [2025-04-21 14:09:01.445108] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2290, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:01.445184] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=184, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:01.445247] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:01.445288] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3168, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:01.445322] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:01.445408] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:01.456676] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:01.456793] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=105] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.461930] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.475127] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=63] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.475906] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=135] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.475967] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.476142] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.481534] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=18] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215741191562001, v:0}, base_version={val:1745215740704499001, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215741191562001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215741481488, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:01.485301] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8783) [2025-04-21 14:09:01.485427] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8783) [2025-04-21 14:09:01.485495] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=111, avg_log_gen_to_submit_time=132, avg_log_submit_to_flush_time=3000, avg_log_submit_to_slide_time=3027) [2025-04-21 14:09:01.485551] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8783, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:01.507502] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1210) [2025-04-21 14:09:01.507565] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=7504, avg_log_submit_to_slide_time=7523) [2025-04-21 14:09:01.507605] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2448) [2025-04-21 14:09:01.507635] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=6872, avg_log_submit_to_slide_time=6891) [2025-04-21 14:09:01.507680] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1210, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:01.507714] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2448, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:01.508896] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=21] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:01.508993] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=88] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:01.509039] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=41] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:01.509077] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=36] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:01.511803] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=38] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:01.513478] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=38] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:01.514986] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=39] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:01.515027] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:01.516329] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:01.516436] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:01.516465] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=25] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:01.520873] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:01.521797] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:01.521856] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3972, avg_group_log_size=397) [2025-04-21 14:09:01.521893] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:01.522387] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=40] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:01.522428] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=40] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:01.523343] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1984, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:01.523399] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=54] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3972) [2025-04-21 14:09:01.523441] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=60, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:01.523513] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:01.523550] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2160, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:01.523585] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:01.523669] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3972, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:01.523816] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=27] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:01.523931] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=39] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:01.523959] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:01.528281] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=23] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:01.529782] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=39] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:01.529821] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:01.531150] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:01.531256] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:01.531286] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:01.531321] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=23] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:01.531394] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=64] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:01.531418] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=21] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:01.531453] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=30] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:01.531487] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=33] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:01.531510] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:01.531529] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=18] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:01.531556] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:01.531580] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=24] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:01.531602] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:01.531619] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:01.531646] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=25] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:01.531669] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:01.532873] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=16] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:01.532915] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=40] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:01.532933] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:01.532979] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=21] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:01.533023] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=42] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:01.533048] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=24] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:01.533074] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=22] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:01.533100] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD94-0-0] [lt=24] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:01.555241] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:01.562012] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.564476] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=1400000, clean_num=200000) [2025-04-21 14:09:01.572419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:01.580168] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=87] gc stale ls task succ [2025-04-21 14:09:01.581923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:01.581974] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.583970] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=57] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:01.584041] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=61] temporary file module use no blocks [2025-04-21 14:09:01.584060] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:01.584089] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:01.584120] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=29] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254946134204, flush_io_finished_ret_:0, flush_io_finished_round_:133, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:01.596516] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=63] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:01.604594] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:01.604645] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:01.604844] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=30] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:01.606094] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:01.606121] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2448) [2025-04-21 14:09:01.606192] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215735579281000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:01.606228] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:01.606276] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:01.606419] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:01.606458] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:01.607707] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2448) [2025-04-21 14:09:01.616472] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC8-0-0] [lt=38] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:01.629820] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0112-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.632278] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0114-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.636451] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0115-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.636455] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010B-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.638117] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0117-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.638866] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010B-0-0] [lt=33][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254947189172, cache_obj->added_lc()=false, cache_obj->get_object_id()=695, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:01.652057] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0118-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.654663] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F011A-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.662097] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.695293] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=117] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.695357] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.695395] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.695399] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.695950] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=52] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696170] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=91] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696333] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=90] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696433] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696433] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.696478] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=18] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:01.703199] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F011C-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.708225] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=76] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215741708206], gts:1745215741707181000, latest_srr:[mts=1745215741708206]}) [2025-04-21 14:09:01.709129] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1745215741708246000, start_id=1745215741708246000, end_id=1745215741708246001) [2025-04-21 14:09:01.711235] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0120-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.711355] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=18] PNIO [ratelimit] time: 1745215741711351, bytes: 4791796, bw: 0.012967 MB/s, add_ts: 1007495, add_bytes: 13699 [2025-04-21 14:09:01.762169] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.764965] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=35] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:01.772539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:01.775684] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4051, offset=71757}, end_cursor:ObLogCursor{file_id=3, log_id=4052, offset=72063}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77518050, len:1971, log_data_len:306, seq:4051, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:01.776776] INFO [SERVER.OMT] recv_group_request (ob_tenant.cpp:1418) [619532][pnio1][T0][YB420B1D7AB6-00063343AEEEFE62-0-0] [lt=17] worker thread created(id()=1002, group->group_id_=18) [2025-04-21 14:09:01.776781] INFO [SHARE] pre_run (ob_tenant_base.cpp:320) [624907][][T1002][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1002, ret=0, thread_count_=150) [2025-04-21 14:09:01.776869] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [624907][][T1002][Y0-0000000000000000-0-0] [lt=78] Init thread local success [2025-04-21 14:09:01.776967] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE62-0-0] [lt=24] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:01.777058] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE62-0-0] [lt=34] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215741206674002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215741206674002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:01.782768] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=588] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4052, offset=72063}, end_cursor:ObLogCursor{file_id=3, log_id=4053, offset=72360}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7751c050, len:1665, log_data_len:297, seq:4052, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:01.783026] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE62-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:01.783086] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE62-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215741708246000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215741708246000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:01.787022] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=15] PNIO [ratelimit] time: 1745215741787018, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007550, add_bytes: 0 [2025-04-21 14:09:01.790768] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=79] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:01.810138] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=24] ====== traversal_flush timer task ====== [2025-04-21 14:09:01.810245] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA1-0-0] [lt=45] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:01.810366] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA1-0-0] [lt=114] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:01.814213] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:01.814264] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:01.815652] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0122-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.816920] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:01.817051] WDIAG read_multi_row (ob_table_access_helper.h:238) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:01.817829] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0124-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.818576] INFO delete_row (ob_table_access_helper.h:312) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=29] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215741817082) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215741817082) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:01.824480] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:09:01.828837] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=36] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:01.828898] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:01.828931] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=31] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:01.828965] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=31] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:01.828992] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254946379058, flush_io_finished_ret_:0, flush_io_finished_round_:133, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:01.831339] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0127-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.831945] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0128-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:01.833335] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=81] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:01.844681] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:01.845672] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=47] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:01.845737] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=64] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:01.845818] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=47] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:01.845920] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=97] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:01.845966] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:01.845993] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215738572266001, v:0}) [2025-04-21 14:09:01.846012] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:01.846029] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:01.846052] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:01.846083] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:01.846104] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:01.846133] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:01.846165] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:01.846186] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:01.852542] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=21] clear dtl interm result cost(us)(clear_cost=3637, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:01.853443] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=44] ====== tenant freeze timer task ====== [2025-04-21 14:09:01.862193] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.879845] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:01.879934] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.883810] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:01.885790] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215741206674002, v:0}, new_max_version={val:1745215741206674002, v:0}, last_min_version={val:1745215741206674000, v:0}, last_max_version={val:1745215741206674000, v:0}, total_time_us=3946, delta_us=679113) [2025-04-21 14:09:01.885835] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215741206674002, v:0}, min_version={val:1745215741206674002, v:0}, max_version={val:1745215741206674002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:01.895110] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE54-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:01.895172] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE54-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:01.943542] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=36] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:01.957175] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:01.957253] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:01.959063] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=45] current monitor number(seq_=-1) [2025-04-21 14:09:01.962273] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:01.965747] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:01.972672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:01.983179] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4119) [2025-04-21 14:09:01.983248] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1796, avg_log_submit_to_slide_time=1817) [2025-04-21 14:09:01.997078] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=74] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:02.007938] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=43][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:02.015559] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=79] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:02.036904] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=73] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:02.062338] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.082085] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:02.082137] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.122385] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:02.122427] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] try gc retain ctx [2025-04-21 14:09:02.122451] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] try to retry start_working [2025-04-21 14:09:02.122488] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215741979953000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215737068440000, v:0}, keep_alive_scn_:{val:1745215737116906001, v:0}, update_ts_:1745215742121377}) [2025-04-21 14:09:02.123486] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:02.123614] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=95] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:09:02.142147] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215742043232000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215742142094}, version_delta=98912) [2025-04-21 14:09:02.162405] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.166235] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:02.172777] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:02.178650] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215741979953000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198687, in_cluster_service=true, cluster_version={val:1745215741779327000, v:0}, min_cluster_version={val:1745215741779327000, v:0}, max_cluster_version={val:1745215741779327000, v:0}, get_cluster_version_err=0, cluster_version_delta=399313, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1221, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=79708777, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:02.205327] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010D-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.207646] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010D-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254947757954, cache_obj->added_lc()=false, cache_obj->get_object_id()=696, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:02.208480] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=44] ts response task statistics(alloc_count=2958, free_count=1478) [2025-04-21 14:09:02.208535] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=42] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=405, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:02.208566] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:02.262492] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.263933] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFF-0-0] [lt=29] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:02.263983] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFDFF-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:02.314748] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE59-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:02.314827] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE59-0-0] [lt=76] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:02.336066] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=49] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:02.336150] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:02.336335] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:02.336529] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:02.336611] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:16, schedule:31, submit:7, rt:1991, total:2045) [2025-04-21 14:09:02.336698] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:02.336772] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:16, schedule:31, submit:7, device:1991, total:2045) [2025-04-21 14:09:02.336834] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:02.336907] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:689, total:701) [2025-04-21 14:09:02.336984] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:02.337064] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:689, total:701) [2025-04-21 14:09:02.337124] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:02.337157] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:02.362573] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.366772] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:02.377883] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6500000, replace_num=100000) [2025-04-21 14:09:02.377936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:02.380047] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:02.380131] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.404320] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=30] ====== check clog disk timer task ====== [2025-04-21 14:09:02.404404] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=71] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:09:02.406743] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:02.406804] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:02.406853] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:02.406889] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:02.406921] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:02.408350] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1473, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:02.408393] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:09:02.408429] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:02.408410] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1587, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:02.408461] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:02.408497] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:02.408536] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1588, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:02.408569] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:02.408615] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:02.408636] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1722, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:02.408657] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:02.415139] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=49] ====== tenant freeze timer task ====== [2025-04-21 14:09:02.421182] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:09:02.429495] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:02.433335] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=63] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:02.433394] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:02.433425] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:02.433412] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:02.433506] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=90] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:02.433531] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254946983564, flush_io_finished_ret_:0, flush_io_finished_round_:134, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:02.443957] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFEA-0-0] [lt=52] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035827684402465820e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.737949763019373677e+02) [2025-04-21 14:09:02.444276] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8261, avg_group_log_size=516) [2025-04-21 14:09:02.444318] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8261) [2025-04-21 14:09:02.445831] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=74] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1561, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:02.445883] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:02.445950] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:02.445977] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1680, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:02.446006] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:02.457416] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:02.457496] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.462666] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.475249] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.475963] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=67] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.476014] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.476092] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.487084] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8261) [2025-04-21 14:09:02.487185] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8261) [2025-04-21 14:09:02.487243] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1651, avg_log_submit_to_slide_time=1669) [2025-04-21 14:09:02.487302] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8261, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:02.508320] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:09:02.508375] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1564, avg_log_submit_to_slide_time=1583) [2025-04-21 14:09:02.508415] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:02.508439] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1692, avg_log_submit_to_slide_time=1700) [2025-04-21 14:09:02.508485] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:02.508521] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:02.522757] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:02.522825] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3525, avg_group_log_size=352) [2025-04-21 14:09:02.522856] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:02.524158] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1576, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:02.524205] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3525) [2025-04-21 14:09:02.524234] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:02.524309] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:02.524338] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1689, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:02.524361] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:02.524401] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3525, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:02.544916] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8D-0-0] [lt=26] MediumCheckTask(cost_ts=11) [2025-04-21 14:09:02.562748] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.567319] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:02.569893] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:09:02.569948] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:02.578006] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:02.580252] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:02.582294] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:02.582362] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.584252] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:02.584341] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=76] temporary file module use no blocks [2025-04-21 14:09:02.584362] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:02.584394] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:02.584428] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=32] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254947134482, flush_io_finished_ret_:0, flush_io_finished_round_:134, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:02.596695] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:02.601335] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=26] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:02.601392] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=41] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=27) [2025-04-21 14:09:02.604985] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:02.605068] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=81][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:02.606839] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:02.606852] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:02.606875] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:02.606933] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:02.606962] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:02.607548] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:02.607614] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=54] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:02.607675] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:02.608653] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:02.633591] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F012A-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.635780] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F012C-0-0] [lt=53][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.638976] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F012D-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.640588] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F012F-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.646343] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:02.655785] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0130-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.657748] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0132-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.660012] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=78] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:02.662818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.663750] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=107] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:02.666083] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=42] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26191252}, readable_log_tail:{lsn:26191252}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40913516, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:02.666211] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=127] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:02.666253] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=18] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:02.688826] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] [COMPACTION DAG STATUS] (start_time=1745215732685273, end_time=1745215742688821, dag_status={}) [2025-04-21 14:09:02.688896] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=66] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.688919] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.688933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.688947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.688974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.688994] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.689038] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=43] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.689063] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.689088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:02.689115] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689147] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689170] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689194] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689246] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689266] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689286] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689327] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689347] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689367] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689387] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689408] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689452] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689472] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689492] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689535] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689576] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689649] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689743] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689776] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689842] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=44] log compressor cycles once. (ret=0, cost_time=1069, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017335808, fast_delete_log_mode=false) [2025-04-21 14:09:02.689871] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689902] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689964] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.689993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690023] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=54] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690145] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690188] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=40] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690238] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690286] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690333] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690392] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690444] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=50] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690478] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690512] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690536] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690557] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690578] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690617] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690637] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690657] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690676] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690724] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=47] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690745] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690765] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690806] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690827] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690847] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:02.690933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:02.690959] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:02.690985] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:02.691005] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:02.691029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:02.691050] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:02.691070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:02.691092] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:02.691181] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=87] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:02.691193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:02.691212] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:02.694676] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695431] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695430] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695490] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695497] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695910] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.695963] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.696124] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.696325] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.696422] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.696518] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:02.702855] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=14, gc_interval=10000000) [2025-04-21 14:09:02.702966] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=59] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:02.703023] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=39] gc_check_member_list_ cost time(ret=0, time_us=105) [2025-04-21 14:09:02.703071] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=33] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:02.705747] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=27] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:02.705799] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=43] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:02.705822] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=26) [2025-04-21 14:09:02.705846] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyHandler start process [2025-04-21 14:09:02.705867] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:02.705939] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:02.709104] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215742709086], gts:1745215742708067000, latest_srr:[mts=1745215742709086]}) [2025-04-21 14:09:02.717501] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=51] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:02.719004] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215742719000, bytes: 4804568, bw: 0.012088 MB/s, add_ts: 1007649, add_bytes: 12772 [2025-04-21 14:09:02.726747] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:02.728001] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=58] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:02.728101] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215738772378000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:02.762898] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.765206] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=88] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:02.767879] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:02.778108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:02.788585] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4053, offset=72360}, end_cursor:ObLogCursor{file_id=3, log_id=4054, offset=72666}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77520050, len:1368, log_data_len:306, seq:4053, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:02.789019] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE63-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:02.789119] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE63-0-0] [lt=89] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215742207779004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215742207779004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:02.790888] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:02.794638] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215742794634, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2025-04-21 14:09:02.795349] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=64] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4054, offset=72666}, end_cursor:ObLogCursor{file_id=3, log_id=4055, offset=72963}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77524050, len:1062, log_data_len:297, seq:4054, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:02.795594] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE63-0-0] [lt=46] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:02.795654] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE63-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215742207779004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215742207779004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:02.797139] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16169, max_lsn:26192975, max_scn:{val:1745215742792324000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26192975}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26191840}, last_submit_end_lsn:{lsn:26192975}, last_submit_log_id:16169, last_submit_log_pid:3, max_flushed_lsn:{lsn:26191840}, max_flushed_end_lsn:{lsn:26192975}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26192975}, last_slide_log_id:16169, last_slide_scn:{val:1745215742792324000, v:0}, last_slide_lsn:{lsn:26191840}, last_slide_end_lsn:{lsn:26192975}, last_slide_log_pid:3, last_slide_log_accum_checksum:2434212482, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16170, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26192975}, readable_log_tail:{lsn:26192975}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40911793, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:02.797404] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=256] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215742793867, last_flushed_end_lsn:{lsn:26192975}}]) [2025-04-21 14:09:02.797432] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=25] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16170, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215742793867, last_flushed_end_lsn:{lsn:26192975}}]) [2025-04-21 14:09:02.819139] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0134-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.821215] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0136-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.824558] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:02.829142] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=62] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:02.829219] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=68] temporary file module use no blocks [2025-04-21 14:09:02.829239] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:02.829262] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:02.829295] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=31] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254947379371, flush_io_finished_ret_:0, flush_io_finished_round_:134, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:02.833486] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:02.836375] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0139-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.837083] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F013A-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:02.862977] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.878289] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=50] BlockGCTimerTask success(ret=0, cost_time_us=30, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):88, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:02.880255] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:02.880310] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.884643] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:02.886879] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215742207779003, v:0}, new_max_version={val:1745215742207779003, v:0}, last_min_version={val:1745215742207779001, v:0}, last_max_version={val:1745215742207779001, v:0}, total_time_us=4208, delta_us=679097) [2025-04-21 14:09:02.886929] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215742207779003, v:0}, min_version={val:1745215742207779003, v:0}, max_version={val:1745215742207779003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:02.896561] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE55-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:02.896626] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE55-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:02.897215] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=50] LogLoopThread round_cost_time(us)(round_cost_time=375) [2025-04-21 14:09:02.924738] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=39] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:02.957666] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:02.957761] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=85] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:02.963067] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:02.968390] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:02.978261] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:02.984078] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:09:02.984156] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1790, avg_log_submit_to_slide_time=1812) [2025-04-21 14:09:03.019490] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=43] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:03.019521] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBE-0-0] [lt=29] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:03.019548] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=56] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:03.019571] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBE-0-0] [lt=45] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:03.037139] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=140] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:03.063153] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.082499] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:03.082572] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.163236] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.168956] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:03.178401] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:03.181523] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=74] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3648) [2025-04-21 14:09:03.209655] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=68] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215743209621], gts:1745215743209052000, latest_srr:[mts=1745215743209621]}) [2025-04-21 14:09:03.209720] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=63] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:03.210888] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010F-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.213384] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF010F-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254948763692, cache_obj->added_lc()=false, cache_obj->get_object_id()=697, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:03.250450] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC6-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:03.250516] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC6-0-0] [lt=57] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=68) [2025-04-21 14:09:03.263310] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.266472] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE00-0-0] [lt=28] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:03.266538] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE00-0-0] [lt=62] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:03.316571] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5A-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:03.316643] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5A-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:03.325577] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:03.338193] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:03.338256] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:03.338426] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:03.338607] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:03.338703] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:15, schedule:30, submit:8, rt:1188, total:1242) [2025-04-21 14:09:03.338793] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:03.338858] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:15, schedule:30, submit:8, device:1188, total:1242) [2025-04-21 14:09:03.338923] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:03.338994] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:712, total:725) [2025-04-21 14:09:03.339075] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:03.339114] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:712, total:725) [2025-04-21 14:09:03.339180] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:03.339209] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:03.363381] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.369518] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=99] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:03.378565] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=69] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:03.380458] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:03.380540] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.407445] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:03.407511] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:03.407543] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:03.407574] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:03.407606] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:03.409138] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1604, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:03.409214] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:03.409222] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1547, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:03.409263] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:03.409264] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:03.409303] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:03.409304] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1740, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:03.409336] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:03.409376] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:03.409398] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1659, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:03.409415] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:03.421264] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:03.430327] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:03.433602] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:03.433673] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:03.433723] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:03.433748] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:03.433780] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:03.433806] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254947983890, flush_io_finished_ret_:0, flush_io_finished_round_:135, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:03.444783] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFEF-0-0] [lt=57] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035827684402465820e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.737949763019373677e+02) [2025-04-21 14:09:03.445100] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8262, avg_group_log_size=516) [2025-04-21 14:09:03.445142] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8262) [2025-04-21 14:09:03.446609] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1601, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:03.446673] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:03.446772] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:03.446817] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1732, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:03.446848] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:03.457899] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:03.457982] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.463473] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.475185] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.475370] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.476063] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.476104] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=68] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.487544] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8262) [2025-04-21 14:09:03.487635] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8262) [2025-04-21 14:09:03.487698] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1702, avg_log_submit_to_slide_time=1723) [2025-04-21 14:09:03.487787] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8262, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:03.509332] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:03.509448] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=84] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1653, avg_log_submit_to_slide_time=1679) [2025-04-21 14:09:03.509529] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:03.509553] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1731, avg_log_submit_to_slide_time=1744) [2025-04-21 14:09:03.509601] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:03.509540] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=29, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:03.509660] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:03.509659] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=118] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1662, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:03.509688] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=28] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:03.509703] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=-554, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:03.509717] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=23, stat_interval=5000000, avg (count/cost)=1137, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:03.523576] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:03.523664] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:03.523706] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:03.525393] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1660, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:03.525466] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=71] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:03.525504] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:03.525583] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:03.525626] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1801, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:03.525653] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:03.525692] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:03.551758] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620299][T1002_ObXAHbWor][T1002][Y0-0000000000000000-0-0] [lt=48] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:03.558616] INFO [ARCHIVE] load_archive_round_attr (ob_archive_persist_mgr.cpp:323) [620314][T1002_ArcSrv][T1002][YB420B1D7AB6-00063343AF5EFD86-0-0] [lt=56] no archive dest exist, just skip(ret=-4018, tenant_id_=1002) [2025-04-21 14:09:03.563561] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.566081] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:09:03.566252] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA0-0-0] [lt=51] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215743209052001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215740205586004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:03.566492] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA0-0-0] [lt=187] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215740205586004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:03.566630] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA0-0-0] [lt=133] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:03.570038] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:03.578725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:03.579943] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=1600000, clean_num=200000) [2025-04-21 14:09:03.580342] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:03.582711] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:03.582779] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.584579] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:03.584663] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=73] temporary file module use no blocks [2025-04-21 14:09:03.584696] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=30] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:03.584736] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:03.584774] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254948134790, flush_io_finished_ret_:0, flush_io_finished_round_:135, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:03.596918] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=64] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:03.605293] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:03.605346] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:03.607181] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:03.607221] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:03.607629] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:03.607717] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:03.607748] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:03.609818] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:03.622352] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDC9-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:03.636997] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F013C-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.639300] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F013E-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.641437] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F013F-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.642778] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0141-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.644933] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215743644431000, start_id=1745215743644431000, end_id=1745215743644431001) [2025-04-21 14:09:03.654048] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:09:03.655113] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:03.655182] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=67] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:03.655269] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=50] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215740205586004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:03.655378] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=105] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:03.655412] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:03.655439] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215734200261001, v:0}) [2025-04-21 14:09:03.655458] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:03.655483] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:03.655512] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:03.655534] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:03.655564] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:03.655597] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:03.656605] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:03.656645] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:03.656698] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215740205586004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:03.656763] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=62] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:03.656779] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:03.656799] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:03.656822] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:03.656842] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:03.656863] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:03.656888] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:03.656905] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:03.658822] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0142-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.660560] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0144-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.663627] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.694646] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695000] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695502] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695569] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695788] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=67] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695857] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695861] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695902] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.695918] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=37] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:03.696001] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.696543] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.696610] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:03.710142] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215743709736000, start_id=1745215743709736000, end_id=1745215743709736001) [2025-04-21 14:09:03.717068] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDF5-0-0] [lt=73] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:03.726596] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1745215743726590, bytes: 4818791, bw: 0.013462 MB/s, add_ts: 1007590, add_bytes: 14223 [2025-04-21 14:09:03.748748] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDF3-0-0] [lt=26] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:03.763183] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA2-0-0] [lt=40] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:03.763833] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=84] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:03.763880] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:03.763904] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.778890] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:03.780487] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:03.791017] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:03.801360] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4055, offset=72963}, end_cursor:ObLogCursor{file_id=3, log_id=4056, offset=73269}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77528050, len:765, log_data_len:306, seq:4055, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:03.801744] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:03.801829] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=59] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215743209052004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215743209052004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:03.802254] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215743802249, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2025-04-21 14:09:03.805179] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=19] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215742207779004, v:0}, new_replayable_scn={val:1745215742207779004, v:0}, new_readable_scn={val:1745215742207779004, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215741708246000, replayable_scn:1745215741708246000, readable_scn:1745215741708246000, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:03.805506] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1745215743805247000, start_id=1745215743805247000, end_id=1745215743805247001) [2025-04-21 14:09:03.807684] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:03.807723] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] try gc retain ctx [2025-04-21 14:09:03.807737] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:03.807778] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] finish update min start scn(max_decided_scn={val:1745215743209052004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215733698951000, v:0}, keep_alive_scn_:{val:1745215738703981000, v:0}, update_ts_:1745215743807377}) [2025-04-21 14:09:03.808490] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=67] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4056, offset=73269}, end_cursor:ObLogCursor{file_id=3, log_id=4057, offset=73566}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7752c050, len:459, log_data_len:297, seq:4056, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:03.808801] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215741708246000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215750473222000, latest_log_ts:{val:1745215734200261001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:03.808990] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=129] finish update min start scn(max_decided_scn={val:1745215743209052004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215733698951000, v:0}, keep_alive_scn_:{val:1745215738703981000, v:0}, update_ts_:1745215743808444}) [2025-04-21 14:09:03.809768] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:03.809846] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE64-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215743209052004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215743209052004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:03.810002] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215741708246000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:03.814389] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:03.814439] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:03.822509] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0146-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.824634] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0148-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.824629] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:09:03.829435] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:03.829498] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=55] temporary file module use no blocks [2025-04-21 14:09:03.829524] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:03.829554] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:03.829580] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254948379659, flush_io_finished_ret_:0, flush_io_finished_round_:135, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:03.833675] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:03.840337] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F014B-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.840901] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F014C-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:03.848097] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:03.855091] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=48] ====== tenant freeze timer task ====== [2025-04-21 14:09:03.863810] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.880677] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:03.880766] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=79] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.885644] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:03.887675] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215743209052003, v:0}, new_max_version={val:1745215743209052003, v:0}, last_min_version={val:1745215743209052001, v:0}, last_max_version={val:1745215743209052001, v:0}, total_time_us=4134, delta_us=678620) [2025-04-21 14:09:03.887725] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215743209052003, v:0}, min_version={val:1745215743209052003, v:0}, max_version={val:1745215743209052003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:03.898350] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE56-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:03.898413] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE56-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:03.906754] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDDC-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215743906733}) [2025-04-21 14:09:03.906817] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDDC-0-0] [lt=40] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215743906811}) [2025-04-21 14:09:03.906814] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0D-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215743906789, sql_renew_time:1745215743906789, is_mark_fail:false}]) [2025-04-21 14:09:03.906863] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0D-0-0] [lt=47] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215743906733}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215743906789, sql_renew_time:1745215743906789, is_mark_fail:false}]) [2025-04-21 14:09:03.906905] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0E-0-0] [lt=31] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:03.907370] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0E-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215743907356, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:03.907423] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0E-0-0] [lt=52] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215743906811}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215743907356, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:03.908337] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDDC-0-0] [lt=22] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:03.909382] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=54, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:03.909430] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=47] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=3776, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:03.909446] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:03.909460] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=-512, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:03.909475] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=3318, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:03.910129] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:03.910267] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:03.913818] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=39] ls blacklist refresh finish(cost_time=8223) [2025-04-21 14:09:03.921879] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:03.923680] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1745215743923181000, start_id=1745215743923181000, end_id=1745215743923181001) [2025-04-21 14:09:03.940981] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDF7-0-0] [lt=76] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:03.958132] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:03.958213] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:03.959362] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=79] current monitor number(seq_=-1) [2025-04-21 14:09:03.963882] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:03.979055] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:03.981022] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:03.983614] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215743209052004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=774543, in_cluster_service=true, cluster_version={val:1745215743209052003, v:0}, min_cluster_version={val:1745215743209052003, v:0}, max_cluster_version={val:1745215743209052003, v:0}, get_cluster_version_err=0, cluster_version_delta=774543, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1207, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=74859331, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:03.984064] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:03.984128] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1649, avg_log_submit_to_slide_time=1672) [2025-04-21 14:09:04.006975] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=171] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:04.037289] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=62] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:04.055197] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=547336192, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=526405632, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:04.055343] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=94] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:04.055381] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=223, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:04.055461] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:04.055529] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:04.055553] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=22] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=27, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:04.063951] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.076259] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:04.076326] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=61] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:04.076356] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=27] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:04.076381] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:04.079773] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:04.080134] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=357] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:04.080258] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] get_max_applied_scn(scn={val:1745215743981875000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65825819}, palf_committed_end_scn_:{val:1745215743981875000, v:0}, last_check_scn_:{val:1745215743981875000, v:0}, max_applied_cb_scn_:{val:1745215743981875000, v:0}}) [2025-04-21 14:09:04.080325] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65825819}, readable_log_tail:{lsn:65825819}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1278949, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:04.082922] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:04.082978] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.164033] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.179184] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:04.181528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:04.182098] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=106] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:04.210630] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:04.211012] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=86] submit log success(service_type_=0, last_id=1745215760473222000, limited_id=1745215760473222000) [2025-04-21 14:09:04.211048] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=35] submit log with lock success(service_type_=0, last_id=1745215760473222000, limited_id=1745215760473222000) [2025-04-21 14:09:04.211091] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=430, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:04.212118] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=12] update id meta(ret=0, service_type=0, limited_id=1745215760473222000, latest_scn={val:1745215744209918001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215741708246000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:04.212212] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=93] handle submit callback(service_type_=0, success=true, used_ts=1201, log_ts={val:1745215744209918001, v:0}, limited_id=1745215760473222000) [2025-04-21 14:09:04.212233] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=21] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:04.212249] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F011F-0-0] [lt=14] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:04.216757] WDIAG begin (ob_hashtable.h:954) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD92-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.219122] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD92-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254949769429, cache_obj->added_lc()=false, cache_obj->get_object_id()=698, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:04.232353] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=64] [APPLY STAT CB APPEND COST TIME](cur_stat_count=73, stat_interval=5000000, avg (count/cost)=55, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:04.232416] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=60] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=73, stat_interval=5000000, avg (count/cost)=2162, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:04.232440] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=23] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=73, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:04.232471] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=28] [APPLY STAT CB EXECUTE TIME](cur_stat_count=73, stat_interval=5000000, avg (count/cost)=-576, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:04.232500] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=27] [APPLY STAT CB TOTAL TIME](cur_stat_count=73, stat_interval=5000000, avg (count/cost)=1642, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:04.248359] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=68] get_max_applied_scn(scn={val:1745215744084744000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26205723}, palf_committed_end_scn_:{val:1745215744246528000, v:0}, last_check_scn_:{val:1745215744246528000, v:0}, max_applied_cb_scn_:{val:1745215744084744000, v:0}}) [2025-04-21 14:09:04.248445] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26205723}, readable_log_tail:{lsn:26205723}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40899045, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:04.264129] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.268405] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE01-0-0] [lt=40] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:04.268460] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE01-0-0] [lt=52] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:04.287979] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=95] get_max_applied_scn(scn={val:1745215743709736003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17363894}, palf_committed_end_scn_:{val:1745215744209918001, v:0}, last_check_scn_:{val:1745215744209918001, v:0}, max_applied_cb_scn_:{val:1745215743709736003, v:0}}) [2025-04-21 14:09:04.288051] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=61] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17363894}, readable_log_tail:{lsn:17363894}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49740874, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:04.291540] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=45] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:04.318506] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5B-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:04.318581] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5B-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:04.340243] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:04.340353] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:04.340586] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:04.340832] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:04.340946] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:18, schedule:37, submit:9, rt:1277, total:1342) [2025-04-21 14:09:04.341077] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:04.341175] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:18, schedule:37, submit:9, device:1277, total:1342) [2025-04-21 14:09:04.341244] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:04.341348] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:624, total:637) [2025-04-21 14:09:04.341452] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:04.341533] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:624, total:637) [2025-04-21 14:09:04.341617] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:04.341658] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:04.364212] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.379328] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:04.379645] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:04.380874] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=44] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:04.380895] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:04.380971] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.380989] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=54] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215741191562000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:04.382040] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:04.384050] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=105] get_max_applied_scn(scn={val:1745215743709736004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8781003}, palf_committed_end_scn_:{val:1745215744209918000, v:0}, last_check_scn_:{val:1745215744209918000, v:0}, max_applied_cb_scn_:{val:1745215743709736004, v:0}}) [2025-04-21 14:09:04.384109] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8781003}, readable_log_tail:{lsn:8781003}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58323765, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:04.390353] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=39] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:04.400222] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:04.400292] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=54] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:04.400325] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=28] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=28) [2025-04-21 14:09:04.400630] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:04.400757] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA1-0-0] [lt=39] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215744285046000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:04.400891] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA1-0-0] [lt=126] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:04.404530] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:04.404573] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=33] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=88) [2025-04-21 14:09:04.408203] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:04.408263] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:09:04.408302] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:04.408333] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:04.408361] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:04.409758] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1446, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:04.409804] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:04.409839] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:04.409818] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1513, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:04.409881] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:04.409916] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:04.409944] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1562, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:04.409966] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:04.410011] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:04.410033] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1660, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:04.410056] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:04.412969] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=53][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:04.413168] WDIAG read_multi_row (ob_table_access_helper.h:238) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=67][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:04.414938] INFO delete_row (ob_table_access_helper.h:312) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=34] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215744413203) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215744413203) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:04.416935] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:09:04.421346] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:04.431189] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:04.433766] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:04.433945] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:04.434001] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:04.434024] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:04.434049] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:04.434072] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254948984166, flush_io_finished_ret_:0, flush_io_finished_round_:136, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:04.439867] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:04.440842] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=51] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:04.440912] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=68] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:04.440993] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=42] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:04.441127] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=128] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:04.441177] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:04.441206] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215741282879001, v:0}) [2025-04-21 14:09:04.441222] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:04.441236] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:04.441254] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=12] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:04.441287] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:04.441311] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:04.441345] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:04.441392] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:04.441415] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:04.445651] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFF4-0-0] [lt=153] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.035827684402465820e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=401, Throttle Trigger(MB)=241, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.737949763019373677e+02) [2025-04-21 14:09:04.445988] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8809, avg_group_log_size=518) [2025-04-21 14:09:04.446033] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8809) [2025-04-21 14:09:04.447479] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1484, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:04.447534] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:04.447596] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:04.447625] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1606, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:04.447648] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:04.458346] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:04.458415] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.464306] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=74][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.474286] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=51] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:04.474892] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.475289] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.475356] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.476225] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=66] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.487976] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8809) [2025-04-21 14:09:04.488071] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8809) [2025-04-21 14:09:04.488131] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1550, avg_log_submit_to_slide_time=1569) [2025-04-21 14:09:04.488190] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8809, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:04.509854] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:04.509926] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:04.509990] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1515, avg_log_submit_to_slide_time=1533) [2025-04-21 14:09:04.510047] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1217) [2025-04-21 14:09:04.510076] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1597, avg_log_submit_to_slide_time=1608) [2025-04-21 14:09:04.510122] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:04.510163] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1217, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:04.517795] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=53] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:04.524380] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:04.524447] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:04.524479] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:04.525850] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2019, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:04.525895] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:04.525926] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:04.525998] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:04.526023] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2151, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:04.526054] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:04.526125] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:04.564387] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.570086] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:09:04.570137] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:04.580473] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:04.582562] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43603116032, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:04.583107] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:04.583159] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.584367] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6600000, replace_num=100000) [2025-04-21 14:09:04.584411] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:04.584921] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=65] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:04.584979] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:04.585020] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=38] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:04.585050] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:04.585087] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254949135156, flush_io_finished_ret_:0, flush_io_finished_round_:136, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:04.597125] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=59] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:04.605416] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:04.605467] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:04.607327] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:04.607365] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:04.608352] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:04.608429] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:04.608465] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:04.609373] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] ====== tenant freeze timer task ====== [2025-04-21 14:09:04.609425] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:04.609462] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:04.609929] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:09:04.611449] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:04.612663] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:04.612761] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215735579281000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:04.612803] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215735579281000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1745215735579281000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:04.631305] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=47] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:04.631379] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=72] try gc retain ctx [2025-04-21 14:09:04.631395] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:04.631454] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215744485233000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215734614971001, v:0}, keep_alive_scn_:{val:1745215739477030001, v:0}, update_ts_:1745215744631150}) [2025-04-21 14:09:04.632408] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=39] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:04.637131] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=140] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1001, is_allowed_broadcast=true) [2025-04-21 14:09:04.640606] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F014E-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.642953] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0150-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.643538] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0151-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.645378] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0153-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.652766] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0112-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.653391] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:04.653451] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=26) [2025-04-21 14:09:04.654624] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:04.654681] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=43] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:04.654722] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=39] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:04.654742] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=26) [2025-04-21 14:09:04.655293] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0112-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254950205600, cache_obj->added_lc()=false, cache_obj->get_object_id()=699, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:04.656728] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0116-0-0] [lt=53][errcode=-4201] hashtable not init [2025-04-21 14:09:04.656772] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0116-0-0] [lt=42] get cursor info failed(cursor_id=42, get_sessid()=3221487630) [2025-04-21 14:09:04.656909] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215744656882000, start_id=1745215744656882000, end_id=1745215744656882001) [2025-04-21 14:09:04.661662] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0154-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.663855] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0156-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.664471] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.670256] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=87] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:04.681312] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:04.689312] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:04.689375] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=50] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=28) [2025-04-21 14:09:04.692726] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:04.692805] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=61] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:04.692850] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=40] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=28) [2025-04-21 14:09:04.694913] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695591] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695647] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695641] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695682] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=54] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695703] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=90] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695920] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695980] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.695978] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=54] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.696089] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.696697] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:04.711384] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=398, get_gts_with_stc_cnt=60, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=60, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:04.711671] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=75] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215744711647], gts:1745215744711593000, latest_srr:[mts=1745215744711647]}) [2025-04-21 14:09:04.734229] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215744734223, bytes: 4832056, bw: 0.012555 MB/s, add_ts: 1007633, add_bytes: 13265 [2025-04-21 14:09:04.764545] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.782218] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215744781235000, start_id=1745215744781235000, end_id=1745215744781235001) [2025-04-21 14:09:04.783064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:04.784532] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:04.791171] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:04.809874] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215744809867, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:09:04.816442] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=60] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4057, offset=73566}, end_cursor:ObLogCursor{file_id=3, log_id=4058, offset=73872}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77530050, len:4258, log_data_len:306, seq:4057, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:04.816821] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE65-0-0] [lt=55] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:04.816910] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE65-0-0] [lt=61] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215744209918005, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215744209918005, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:04.823461] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=71] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4058, offset=73872}, end_cursor:ObLogCursor{file_id=3, log_id=4059, offset=74169}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77534050, len:3952, log_data_len:297, seq:4058, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:04.823701] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE65-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:04.823753] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE65-0-0] [lt=31] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215744209918004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215744209918004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:04.825851] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:04.825952] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0158-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.827878] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F015A-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.829702] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:04.829754] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:04.829779] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:04.829811] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=30] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:04.829837] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254949379938, flush_io_finished_ret_:0, flush_io_finished_round_:136, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:04.833821] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:04.844666] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F015D-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.845297] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F015E-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:04.864618] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.881128] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:04.881215] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.886382] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=111] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:04.888354] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215744209918003, v:0}, new_max_version={val:1745215744209918003, v:0}, last_min_version={val:1745215744209918001, v:0}, last_max_version={val:1745215744209918001, v:0}, total_time_us=3951, delta_us=678433) [2025-04-21 14:09:04.888408] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215744209918003, v:0}, min_version={val:1745215744209918003, v:0}, max_version={val:1745215744209918003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:04.899993] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE57-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:04.900057] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE57-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:04.909998] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:04.910049] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=45] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:09:04.910084] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=32] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=328, cache_node_num=327) [2025-04-21 14:09:04.910108] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:04.913391] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=328, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}]) [2025-04-21 14:09:04.914092] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=697] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:04.916986] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=60] blacklist_loop exec finished(cost_time=26, is_enabled=true, send_cnt=0) [2025-04-21 14:09:04.958551] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:04.958617] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:04.964686] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:04.983547] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:04.984688] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:04.987865] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=61] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:05.008493] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8D-0-0] [lt=12] MediumCheckTask(cost_ts=10) [2025-04-21 14:09:05.020424] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=29] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:05.020484] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=58] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:05.020468] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBF-0-0] [lt=31] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:05.020515] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDBF-0-0] [lt=42] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:05.032473] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=49] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:05.037444] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=69] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:05.048880] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:05.064758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.071946] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=61] LogLoopThread round_cost_time(us)(round_cost_time=14) [2025-04-21 14:09:05.083321] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:05.083382] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.126275] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4094) [2025-04-21 14:09:05.126375] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=73] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1986, avg_log_submit_to_slide_time=2012) [2025-04-21 14:09:05.164847] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.183632] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3972) [2025-04-21 14:09:05.184026] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:05.184826] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:05.211956] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=45] ts response task statistics(alloc_count=3030, free_count=1514) [2025-04-21 14:09:05.212039] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=69] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:05.222719] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0118-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.225144] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0118-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254950775451, cache_obj->added_lc()=false, cache_obj->get_object_id()=700, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:05.244693] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215745046524000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198158, in_cluster_service=true, cluster_version={val:1745215744845211000, v:0}, min_cluster_version={val:1745215744845211000, v:0}, max_cluster_version={val:1745215744845211000, v:0}, get_cluster_version_err=0, cluster_version_delta=399471, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1219, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=80065275, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:05.251154] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC7-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:05.251218] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC7-0-0] [lt=53] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=65) [2025-04-21 14:09:05.264917] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.270363] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE02-0-0] [lt=30] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:05.270412] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE02-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:05.286642] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] get number(ret=0, service_type_=0, range=1, base_id=1745215745286249000, start_id=1745215745286249000, end_id=1745215745286249001) [2025-04-21 14:09:05.320401] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5C-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:05.320479] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5C-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:05.333896] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:05.342606] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:05.342666] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:05.342882] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:05.343064] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:05.343146] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12260, [delay/us]:prepare:18, schedule:35, submit:9, rt:1321, total:1385) [2025-04-21 14:09:05.343221] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:05.343285] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:18, schedule:35, submit:9, device:1321, total:1385) [2025-04-21 14:09:05.343344] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:05.343416] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:842, total:860) [2025-04-21 14:09:05.343493] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:05.343529] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:842, total:860) [2025-04-21 14:09:05.343587] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:05.343614] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:05.365018] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.369725] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] success to update min reserved snapshot(reserved_snapshot=1745213938772378000, duration=1800, snapshot_gc_ts=1745215738772378000) [2025-04-21 14:09:05.369787] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=31] success to update min reserved snapshot(reserved_snapshot=1745213935579281000, duration=1800, snapshot_gc_ts=1745215735579281000) [2025-04-21 14:09:05.371340] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] update reserved snapshot finished(cost_ts=1620, reserved_snapshot=1745213938772378000) [2025-04-21 14:09:05.371443] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=75] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213935579281000) [2025-04-21 14:09:05.371485] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] update reserved snapshot finished(cost_ts=1709, reserved_snapshot=1745213935579281000) [2025-04-21 14:09:05.379788] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:05.381256] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDA2-0-0] [lt=57] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:05.381336] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:05.381401] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.381785] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215745381341000, start_id=1745215745381341000, end_id=1745215745381341001) [2025-04-21 14:09:05.383254] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65834828, this={dio_aligned_buf:{buf_write_offset:365, buf_padding_size:3731, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3693, truncate_used_ts:1519}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=8192, aligned_block_offset=65830912, buf_len=545, total_write_size=55118, total_write_size_after_dio=593920, ob_pwrite_used_ts=229177, count=131, each_pwrite_cost=1749) [2025-04-21 14:09:05.384560] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:05.384989] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:05.408975] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:05.409066] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:05.409107] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:05.409146] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:05.409181] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:05.410461] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1519, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:05.410539] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:05.410609] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:05.410672] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1665, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:05.410722] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:05.410799] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1592, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:05.410846] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:05.410892] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:05.410957] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:05.410987] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1689, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:05.411020] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:05.421426] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:09:05.432036] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=109] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:05.433923] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:05.434196] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:05.434254] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:05.434279] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:05.434307] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:05.434333] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254949984430, flush_io_finished_ret_:0, flush_io_finished_round_:137, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:05.446556] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFF9-0-0] [lt=72] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.011827135086059570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.818549034406752298e+02) [2025-04-21 14:09:05.446924] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8365, avg_group_log_size=492) [2025-04-21 14:09:05.446976] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8365) [2025-04-21 14:09:05.448318] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1544, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:05.448375] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:05.448445] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:05.448475] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1691, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:05.448499] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:05.458789] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:05.458866] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.465302] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.475050] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.475197] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.475259] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.475318] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.488676] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8365) [2025-04-21 14:09:05.488763] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8365) [2025-04-21 14:09:05.488823] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=53, avg_log_submit_to_flush_time=1612, avg_log_submit_to_slide_time=1631) [2025-04-21 14:09:05.488884] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8365, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:05.510396] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:05.510487] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=69] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1635, avg_log_submit_to_slide_time=1651) [2025-04-21 14:09:05.510545] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:05.510590] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1585, avg_log_submit_to_slide_time=1606) [2025-04-21 14:09:05.510642] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:05.510703] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:05.525090] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:05.525148] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4629, avg_group_log_size=385) [2025-04-21 14:09:05.525181] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:05.526570] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1397, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:05.526622] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4629) [2025-04-21 14:09:05.526655] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:05.526735] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:05.526780] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1570, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:05.526810] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:05.526850] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4629, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:05.545043] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] get wrs ts(ls_id={id:1}, delta=98408, log_service_ts=1745215745445832, min_tx_service_ts=4611686018427387, timestamp={val:1745215745445832000, v:0}) [2025-04-21 14:09:05.545104] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=58, Other_Error_Cnt=0, Submit_Succ_Cnt=42, last_scn="{val:1745215744485233001, v:0}", last_lsn={lsn:26207668}, last_gts={val:1745215745486542000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:05.565369] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.580546] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:09:05.583500] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:05.583555] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.585101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:05.585157] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=76] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:05.594294] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=1800000, clean_num=200000) [2025-04-21 14:09:05.597292] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:05.604959] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:05.605025] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:05.606762] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:05.606799] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:05.609135] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:05.609205] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:05.609238] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:05.610607] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:05.628180] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCA-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:05.644221] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0160-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.646183] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0162-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.646384] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD5-0-0] [lt=55][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.647570] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0164-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.651688] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF011A-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.654096] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF011A-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254951204402, cache_obj->added_lc()=false, cache_obj->get_object_id()=701, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:05.665079] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0165-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.665438] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.667553] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0167-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.695363] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695664] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695723] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695723] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695738] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695764] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695818] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695873] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.695915] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.696785] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:05.708702] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17365480}, readable_log_tail:{lsn:17365480}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49739288, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:05.708835] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=131] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:05.708870] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=29] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8782589}, readable_log_tail:{lsn:8782589}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58322179, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:05.708936] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=66] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:05.708971] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=12] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:05.712502] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=26] handle gts request statistics(total_rt=446, total_cnt=60, avg_rt=7.311475409836065253e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:05.712583] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215745712570], gts:1745215745711657000, latest_srr:[mts=1745215745712570]}) [2025-04-21 14:09:05.733639] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=36] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:05.735019] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=160] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:05.735120] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215738772378000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:05.735165] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215738772378000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1745215738772378000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:05.741823] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=68] PNIO [ratelimit] time: 1745215745741818, bytes: 4846279, bw: 0.013462 MB/s, add_ts: 1007595, add_bytes: 14223 [2025-04-21 14:09:05.747723] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=18] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:05.747781] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=52] finish to resize log external storage handler(current_ts=1745215745747776, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:05.753702] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] Garbage Collector is running(seq_=14, gc_interval=10000000) [2025-04-21 14:09:05.753780] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=42] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:05.753812] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=27] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:05.753835] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_check_member_list_ cost time(ret=0, time_us=90) [2025-04-21 14:09:05.753864] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:05.755268] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:05.755911] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=147] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:05.756521] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=39] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:05.756565] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:05.756591] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:05.756614] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=51) [2025-04-21 14:09:05.756633] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyHandler start process [2025-04-21 14:09:05.759890] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=78] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:05.760808] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA1-0-0] [lt=18] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:05.760855] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA1-0-0] [lt=38] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:05.765509] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.785287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:05.791300] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:05.794770] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:05.814556] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:05.814610] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=48] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:05.817543] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=87] PNIO [ratelimit] time: 1745215745817539, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007672, add_bytes: 0 [2025-04-21 14:09:05.825923] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:09:05.829094] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0169-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.829904] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4059, offset=74169}, end_cursor:ObLogCursor{file_id=3, log_id=4060, offset=74475}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77538050, len:3655, log_data_len:306, seq:4059, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:05.830239] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE66-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:05.830331] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE66-0-0] [lt=62] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215745212198004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215745212198004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:05.831304] WDIAG begin (ob_hashtable.h:954) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8D-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.832142] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:05.832198] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:05.832216] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:05.832243] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:05.832263] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254950380197, flush_io_finished_ret_:0, flush_io_finished_round_:137, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:05.833966] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:05.836506] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4060, offset=74475}, end_cursor:ObLogCursor{file_id=3, log_id=4061, offset=74772}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7753c050, len:3349, log_data_len:297, seq:4060, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:05.836781] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE66-0-0] [lt=61] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:05.836861] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE66-0-0] [lt=54] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215745212198004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215745212198004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:05.848612] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F016D-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.849297] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F016E-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:05.856688] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:09:05.861365] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10325, max_lsn:17365724, max_scn:{val:1745215745712724000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17365724}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17365602}, last_submit_end_lsn:{lsn:17365724}, last_submit_log_id:10325, last_submit_log_pid:3, max_flushed_lsn:{lsn:17365602}, max_flushed_end_lsn:{lsn:17365724}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17365724}, last_slide_log_id:10325, last_slide_scn:{val:1745215745712724000, v:0}, last_slide_lsn:{lsn:17365602}, last_slide_end_lsn:{lsn:17365724}, last_slide_log_pid:3, last_slide_log_accum_checksum:2498743274, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10326, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17365724}, readable_log_tail:{lsn:17365724}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49739044, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:05.861620] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=249] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215745810563, last_flushed_end_lsn:{lsn:17365724}}]) [2025-04-21 14:09:05.861646] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10326, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215745810563, last_flushed_end_lsn:{lsn:17365724}}]) [2025-04-21 14:09:05.861691] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14261, max_lsn:8782833, max_scn:{val:1745215745712724000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:8782833}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:8782711}, last_submit_end_lsn:{lsn:8782833}, last_submit_log_id:14261, last_submit_log_pid:3, max_flushed_lsn:{lsn:8782711}, max_flushed_end_lsn:{lsn:8782833}, max_flushed_log_pid:3, committed_end_lsn:{lsn:8782833}, last_slide_log_id:14261, last_slide_scn:{val:1745215745712724000, v:0}, last_slide_lsn:{lsn:8782711}, last_slide_end_lsn:{lsn:8782833}, last_slide_log_pid:3, last_slide_log_accum_checksum:3905436459, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14262, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:8782833}, readable_log_tail:{lsn:8782833}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58321935, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:05.861865] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=171] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215745810525, last_flushed_end_lsn:{lsn:8782833}}]) [2025-04-21 14:09:05.861886] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=18] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14262, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215745810525, last_flushed_end_lsn:{lsn:8782833}}]) [2025-04-21 14:09:05.865579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.881506] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:05.881560] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.886894] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:05.888538] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215745212198003, v:0}, new_max_version={val:1745215745212198003, v:0}, last_min_version={val:1745215745212198001, v:0}, last_max_version={val:1745215745212198001, v:0}, total_time_us=3272, delta_us=676337) [2025-04-21 14:09:05.888582] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215745212198003, v:0}, min_version={val:1745215745212198003, v:0}, max_version={val:1745215745212198003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:05.901541] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE58-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:05.901597] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE58-0-0] [lt=53] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:05.924878] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=56] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:05.958513] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=33] current monitor number(seq_=-1) [2025-04-21 14:09:05.958990] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:05.959032] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=35] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:05.961433] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=578) [2025-04-21 14:09:05.965614] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:05.975555] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=68] BlockGCTimerTask success(ret=0, cost_time_us=11, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:05.985417] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:05.995252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:06.015794] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=112] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:06.037573] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=48] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:06.065681] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.083690] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:06.083750] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.124954] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:06.125029] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=70] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:06.125062] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=30] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:06.125088] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=25] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:06.127143] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5519) [2025-04-21 14:09:06.127246] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=36, avg_log_gen_to_submit_time=53, avg_log_submit_to_flush_time=1436, avg_log_submit_to_slide_time=1460) [2025-04-21 14:09:06.127343] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=11] [APPLY STAT CB APPEND COST TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:06.127379] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=35] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=1805, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:06.127394] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:06.127413] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=-527, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:06.127432] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=18] [APPLY STAT CB TOTAL TIME](cur_stat_count=51, stat_interval=5000000, avg (count/cost)=1334, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:06.128282] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:09:06.128628] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=341] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:06.137215] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:06.138823] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFDA1-0-0] [lt=42] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:09:06.139069] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1745215746138529000, start_id=1745215746138529000, end_id=1745215746138529001) [2025-04-21 14:09:06.164448] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=42][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:06.165752] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.183620] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5519) [2025-04-21 14:09:06.185558] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:06.195781] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:06.213084] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=34] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215746213046], gts:1745215746212484000, latest_srr:[mts=1745215746213046]}) [2025-04-21 14:09:06.213155] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=68] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:06.228603] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF011C-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.231155] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF011C-0-0] [lt=44][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254951781461, cache_obj->added_lc()=false, cache_obj->get_object_id()=702, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:06.249038] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:06.265815] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.272194] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE03-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:06.272249] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE03-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:06.285067] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=185] new mysql sessid created(conn.sessid_=3221487805, support_ssl=false) [2025-04-21 14:09:06.285200] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=49] sm conn init succ(conn.sessid_=3221487805, sess.client_addr_="11.29.122.233:63065") [2025-04-21 14:09:06.285250] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=49] accept one succ(*s={this:0x7f3bc7c04d70, session_id:3221487805, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:192}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:06.286206] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=48] username and tenantname(user_name=root, tenant_name=) [2025-04-21 14:09:06.286265] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=37] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:06.286297] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=31] mysql login queue(mysql_queue->queue_.size()=0) [2025-04-21 14:09:06.286400] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB0-0-0] [lt=36] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:06.287280] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB0-0-0] [lt=38] MySQL LOGIN(direct_client_ip="11.29.122.233", client_ip=11.29.122.233, tenant_name=sys, tenant_id=1, user_name=root, host_name=%, sessid=3221487805, proxy_sessid=0, client_sessid=3221487805, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=2164237957, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:06.292180] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10006, add_timestamp:1745215746292157}) [2025-04-21 14:09:06.292247] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0F-0-0] [lt=26] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10006, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215746292218, sql_renew_time:1745215746292218, is_mark_fail:false}]) [2025-04-21 14:09:06.292307] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE0F-0-0] [lt=59] success to process renew task(task={tenant_id:1, table_id:10006, add_timestamp:1745215746292157}, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215746292218, sql_renew_time:1745215746292218, is_mark_fail:false}]) [2025-04-21 14:09:06.293296] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=43][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=secure_file_priv) [2025-04-21 14:09:06.293490] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=42][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=external_user) [2025-04-21 14:09:06.296115] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=24][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=secure_file_priv) [2025-04-21 14:09:06.296280] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=33][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=external_user) [2025-04-21 14:09:06.298123] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0120-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x79afaaf 0x74bbf7c 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.311522] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0121-0-0] [lt=38] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12031, add_timestamp:1745215746311507}) [2025-04-21 14:09:06.311557] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE10-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12031, locations=[{table_id:12031, partition_id:12031, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215746311541, sql_renew_time:1745215746311541, is_mark_fail:false}]) [2025-04-21 14:09:06.311603] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE10-0-0] [lt=46] success to process renew task(task={tenant_id:1, table_id:12031, add_timestamp:1745215746311507}, locations=[{table_id:12031, partition_id:12031, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215746311541, sql_renew_time:1745215746311541, is_mark_fail:false}]) [2025-04-21 14:09:06.315709] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0122-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.317547] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0122-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254951867855, cache_obj->added_lc()=false, cache_obj->get_object_id()=708, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:06.321908] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5D-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:06.321964] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5D-0-0] [lt=53] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:06.344575] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:06.344639] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:06.344814] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:06.344996] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:06.345106] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:17, schedule:38, submit:10, rt:1320, total:1385) [2025-04-21 14:09:06.345183] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:06.345245] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:17, schedule:38, submit:10, device:1320, total:1385) [2025-04-21 14:09:06.345309] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:06.345384] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:640, total:659) [2025-04-21 14:09:06.345466] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:06.345504] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:640, total:659) [2025-04-21 14:09:06.345564] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:06.345592] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:06.365879] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.381678] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:06.381731] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.385686] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:06.396252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:06.404688] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:06.404729] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=36] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:06.409729] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:06.409788] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1522, avg_group_log_size=169) [2025-04-21 14:09:06.409826] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:06.409862] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:06.409905] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:06.411351] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1378, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:06.411383] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1380, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:06.411397] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1098) [2025-04-21 14:09:06.411432] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:06.411432] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:06.411495] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:06.411522] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1489, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:06.411550] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:06.411587] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:06.411608] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1538, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:06.411630] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:06.418416] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=53] ====== tenant freeze timer task ====== [2025-04-21 14:09:06.421501] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:06.432846] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=534] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:06.434080] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:06.434456] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:06.434509] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:06.434534] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:06.434562] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:06.434587] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254950984694, flush_io_finished_ret_:0, flush_io_finished_round_:138, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:06.447165] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DEFFFE-0-0] [lt=55] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.011978530883789062e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.818036847331255785e+02) [2025-04-21 14:09:06.447421] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8382, avg_group_log_size=493) [2025-04-21 14:09:06.447462] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:09:06.448639] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1382, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:06.448692] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:06.448760] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:06.448804] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1539, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:06.448837] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:06.459188] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:06.459245] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.465957] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.474448] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.475036] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.475101] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.476158] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.488930] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8382) [2025-04-21 14:09:06.489043] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8382) [2025-04-21 14:09:06.489116] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1480, avg_log_submit_to_slide_time=1498) [2025-04-21 14:09:06.489181] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8382, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:06.511108] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1522) [2025-04-21 14:09:06.511176] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1471, avg_log_submit_to_slide_time=1493) [2025-04-21 14:09:06.511241] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1522, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:06.511309] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1098) [2025-04-21 14:09:06.511346] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1473, avg_log_submit_to_slide_time=1487) [2025-04-21 14:09:06.511384] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1098, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:06.525928] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:06.525988] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4862, avg_group_log_size=405) [2025-04-21 14:09:06.526016] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:06.527325] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1424, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:06.527362] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4862) [2025-04-21 14:09:06.527398] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:06.527456] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:06.527515] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1569, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:06.527551] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:06.527594] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4862, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:06.566029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.570264] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:09:06.570315] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:06.580630] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:09:06.582008] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215746382254000, v:0}, base_version={val:1745215746183497000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215746382254000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215746581975, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:06.583873] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:06.583937] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.585313] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:06.585369] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:06.585389] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:06.585411] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=20] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:06.585431] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254951135534, flush_io_finished_ret_:0, flush_io_finished_round_:138, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:06.585841] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:06.596774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:06.597466] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:06.605291] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:06.605335] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:06.607012] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:06.607049] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:06.609887] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1522) [2025-04-21 14:09:06.609959] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=1098, avg_group_log_size=122) [2025-04-21 14:09:06.610003] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1098) [2025-04-21 14:09:06.611005] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:09:06.611053] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:06.611097] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:06.611394] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1522) [2025-04-21 14:09:06.647615] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0170-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.648494] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0171-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.649762] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0173-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.650170] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD6-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.666097] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.668392] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0174-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.669789] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0176-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.678339] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:06.681113] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] [COMPACTION DAG STATUS] (start_time=1745215736678268, end_time=1745215746681110, dag_status={}) [2025-04-21 14:09:06.681160] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=43] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681181] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681194] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681249] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681268] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681286] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681304] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:06.681322] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681345] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681365] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681406] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681426] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681445] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681465] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681533] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681552] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681571] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681589] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681609] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681628] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681648] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681667] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681687] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681706] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681746] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681765] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681822] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681849] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681966] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.681995] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682015] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682074] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682174] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682245] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682283] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682301] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682320] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682339] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682358] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682434] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682478] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682497] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682535] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682573] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682593] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682620] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682640] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682678] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:06.682728] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:06.682747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:06.682767] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:06.682783] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:06.682800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:06.682817] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:06.682834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:06.682852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:06.682869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:06.682880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:06.682894] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:06.695020] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695074] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695111] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695735] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695747] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695789] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695796] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695812] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.695823] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.696464] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=51] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.696885] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:06.697548] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:06.697641] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:06.697803] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=62] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:06.714222] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0178-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.718245] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215746717354000, start_id=1745215746717354000, end_id=1745215746717354001) [2025-04-21 14:09:06.719367] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDF7-0-0] [lt=40] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:06.720211] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F017C-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.749438] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215746749433, bytes: 4859051, bw: 0.012088 MB/s, add_ts: 1007615, add_bytes: 12772 [2025-04-21 14:09:06.750862] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDF5-0-0] [lt=72] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:06.766298] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=107] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:06.766334] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:06.766352] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.791422] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:06.792786] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6700000, replace_num=100000) [2025-04-21 14:09:06.792845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:06.797331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:06.810473] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:09:06.810587] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA2-0-0] [lt=46] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:06.810746] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA2-0-0] [lt=151] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:06.825095] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1745215746825088, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007549, add_bytes: 0 [2025-04-21 14:09:06.826020] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:09:06.832619] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F017E-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.833076] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:06.833126] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] temporary file module use no blocks [2025-04-21 14:09:06.833143] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:06.833164] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:06.833202] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=37] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254951382615, flush_io_finished_ret_:0, flush_io_finished_round_:138, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:06.834150] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:06.834643] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0180-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.842607] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4061, offset=74772}, end_cursor:ObLogCursor{file_id=3, log_id=4062, offset=75078}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77540050, len:3052, log_data_len:306, seq:4061, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:06.842959] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE67-0-0] [lt=58] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:06.843028] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE67-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215746212484003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215746212484003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:06.846287] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:09:06.847295] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=41] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:06.847358] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=62] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:06.847433] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=39] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:06.847530] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=92] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:06.847575] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:06.847603] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215738572266001, v:0}) [2025-04-21 14:09:06.847623] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:06.847642] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:06.847665] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:06.847708] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:06.847735] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:06.847767] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:06.847801] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:06.847824] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:06.849603] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=56] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4062, offset=75078}, end_cursor:ObLogCursor{file_id=3, log_id=4063, offset=75375}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77544050, len:2746, log_data_len:297, seq:4062, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:06.849917] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE67-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:06.849982] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE67-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215746717354000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215746717354000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:06.853156] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0183-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.853936] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0184-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:06.866263] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.881846] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:06.881926] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.888040] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:06.889926] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215746212484002, v:0}, new_max_version={val:1745215746212484002, v:0}, last_min_version={val:1745215746212484000, v:0}, last_max_version={val:1745215746212484000, v:0}, total_time_us=3823, delta_us=677439) [2025-04-21 14:09:06.889975] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215746212484002, v:0}, min_version={val:1745215746212484002, v:0}, max_version={val:1745215746212484002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:06.903219] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE59-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:06.903286] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE59-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:06.908490] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDDE-0-0] [lt=39] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:06.914557] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] start to print blacklist info [2025-04-21 14:09:06.914737] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] ls blacklist refresh finish(cost_time=9014) [2025-04-21 14:09:06.929954] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=39] runTimer to refresh locality_info(ret=0) [2025-04-21 14:09:06.931775] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=32] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:09:06.931836] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=49] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:09:06.931874] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=38] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:09:06.931894] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:09:06.931907] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:09:06.931925] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=12] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:09:06.931937] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=11] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:09:06.931957] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:09:06.941063] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=619505, task_cnt=297, avg_time=1432) [2025-04-21 14:09:06.941105] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=41] TIMER THREAD STAT: (thread_id=619506, task_cnt=299, avg_time=555) [2025-04-21 14:09:06.941119] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=14] TIMER THREAD STAT: (thread_id=619792, task_cnt=1992, avg_time=21) [2025-04-21 14:09:06.941134] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=13] TIMER THREAD STAT: (thread_id=619485, task_cnt=170, avg_time=267) [2025-04-21 14:09:06.941145] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=619609, task_cnt=60, avg_time=3) [2025-04-21 14:09:06.941156] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=619838, task_cnt=2992, avg_time=2) [2025-04-21 14:09:06.941168] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=619599, task_cnt=60, avg_time=63) [2025-04-21 14:09:06.941184] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=15] TIMER THREAD STAT: (thread_id=619795, task_cnt=120, avg_time=9) [2025-04-21 14:09:06.941202] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619812, task_cnt=60, avg_time=2) [2025-04-21 14:09:06.941219] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619837, task_cnt=111, avg_time=1039) [2025-04-21 14:09:06.941236] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619487, task_cnt=20, avg_time=469) [2025-04-21 14:09:06.941254] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619659, task_cnt=40, avg_time=43) [2025-04-21 14:09:06.941272] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=18] TIMER THREAD STAT: (thread_id=620086, task_cnt=1992, avg_time=23) [2025-04-21 14:09:06.941289] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620125, task_cnt=2993, avg_time=2) [2025-04-21 14:09:06.941307] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619965, task_cnt=60, avg_time=1818) [2025-04-21 14:09:06.941323] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619998, task_cnt=248, avg_time=5) [2025-04-21 14:09:06.941340] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620089, task_cnt=120, avg_time=10) [2025-04-21 14:09:06.941358] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620106, task_cnt=60, avg_time=3) [2025-04-21 14:09:06.941375] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619488, task_cnt=12, avg_time=86) [2025-04-21 14:09:06.941392] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619981, task_cnt=30, avg_time=114) [2025-04-21 14:09:06.941409] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620124, task_cnt=74, avg_time=1398) [2025-04-21 14:09:06.941427] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619796, task_cnt=12, avg_time=14) [2025-04-21 14:09:06.941444] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619811, task_cnt=12, avg_time=4164) [2025-04-21 14:09:06.941461] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619826, task_cnt=26, avg_time=8619) [2025-04-21 14:09:06.941478] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619831, task_cnt=12, avg_time=38194) [2025-04-21 14:09:06.941489] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620153, task_cnt=60, avg_time=1796) [2025-04-21 14:09:06.941500] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=10] TIMER THREAD STAT: (thread_id=620183, task_cnt=248, avg_time=6) [2025-04-21 14:09:06.941520] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=18] TIMER THREAD STAT: (thread_id=620222, task_cnt=1992, avg_time=22) [2025-04-21 14:09:06.941531] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620263, task_cnt=2992, avg_time=2) [2025-04-21 14:09:06.941542] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620225, task_cnt=120, avg_time=10) [2025-04-21 14:09:06.941560] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620166, task_cnt=30, avg_time=108) [2025-04-21 14:09:06.941576] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620244, task_cnt=60, avg_time=3) [2025-04-21 14:09:06.941594] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619979, task_cnt=12, avg_time=1598) [2025-04-21 14:09:06.941611] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619980, task_cnt=12, avg_time=286) [2025-04-21 14:09:06.941628] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619982, task_cnt=12, avg_time=123) [2025-04-21 14:09:06.941645] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619983, task_cnt=12, avg_time=104) [2025-04-21 14:09:06.941662] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620118, task_cnt=26, avg_time=40964) [2025-04-21 14:09:06.941679] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620090, task_cnt=12, avg_time=16) [2025-04-21 14:09:06.941696] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620105, task_cnt=12, avg_time=3949) [2025-04-21 14:09:06.941713] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620120, task_cnt=12, avg_time=4647) [2025-04-21 14:09:06.941730] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620262, task_cnt=141, avg_time=851) [2025-04-21 14:09:06.941747] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620164, task_cnt=12, avg_time=1530) [2025-04-21 14:09:06.941764] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620165, task_cnt=12, avg_time=343) [2025-04-21 14:09:06.941781] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620168, task_cnt=12, avg_time=104) [2025-04-21 14:09:06.941798] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620167, task_cnt=12, avg_time=125) [2025-04-21 14:09:06.941827] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=27] TIMER THREAD STAT: (thread_id=620292, task_cnt=60, avg_time=1711) [2025-04-21 14:09:06.941844] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620327, task_cnt=248, avg_time=5) [2025-04-21 14:09:06.941860] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=15] TIMER THREAD STAT: (thread_id=619846, task_cnt=6, avg_time=247) [2025-04-21 14:09:06.941880] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=19] TIMER THREAD STAT: (thread_id=620306, task_cnt=30, avg_time=110) [2025-04-21 14:09:06.941898] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620226, task_cnt=12, avg_time=21) [2025-04-21 14:09:06.941915] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620243, task_cnt=12, avg_time=3892) [2025-04-21 14:09:06.941933] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620258, task_cnt=12, avg_time=4118) [2025-04-21 14:09:06.941951] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620256, task_cnt=26, avg_time=6326) [2025-04-21 14:09:06.941963] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620133, task_cnt=6, avg_time=269) [2025-04-21 14:09:06.941976] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=12] TIMER THREAD STAT: (thread_id=620304, task_cnt=12, avg_time=3050) [2025-04-21 14:09:06.941989] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620305, task_cnt=12, avg_time=476) [2025-04-21 14:09:06.942000] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=11] TIMER THREAD STAT: (thread_id=620307, task_cnt=12, avg_time=147) [2025-04-21 14:09:06.942018] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620308, task_cnt=12, avg_time=105) [2025-04-21 14:09:06.942035] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619563, task_cnt=0, avg_time=0) [2025-04-21 14:09:06.942052] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620271, task_cnt=6, avg_time=295) [2025-04-21 14:09:06.942068] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=15] TIMER THREAD STAT: (thread_id=620282, task_cnt=6, avg_time=105) [2025-04-21 14:09:06.942086] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619545, task_cnt=30, avg_time=4) [2025-04-21 14:09:06.942102] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619490, task_cnt=0, avg_time=0) [2025-04-21 14:09:06.942119] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620404, task_cnt=36, avg_time=1491) [2025-04-21 14:09:06.942137] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620397, task_cnt=59, avg_time=30) [2025-04-21 14:09:06.942155] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620403, task_cnt=60, avg_time=3296) [2025-04-21 14:09:06.942172] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619590, task_cnt=60, avg_time=550) [2025-04-21 14:09:06.942189] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620351, task_cnt=30, avg_time=772) [2025-04-21 14:09:06.942206] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619577, task_cnt=36, avg_time=12) [2025-04-21 14:09:06.942224] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619589, task_cnt=12, avg_time=3154) [2025-04-21 14:09:06.942240] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619602, task_cnt=6, avg_time=62) [2025-04-21 14:09:06.942257] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619610, task_cnt=6, avg_time=215) [2025-04-21 14:09:06.942274] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619591, task_cnt=6, avg_time=190) [2025-04-21 14:09:06.942291] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620638, task_cnt=12, avg_time=2145) [2025-04-21 14:09:06.942310] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620280, task_cnt=6, avg_time=8) [2025-04-21 14:09:06.942327] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620281, task_cnt=6, avg_time=8) [2025-04-21 14:09:06.942344] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619992, task_cnt=2, avg_time=61) [2025-04-21 14:09:06.942361] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620177, task_cnt=2, avg_time=59) [2025-04-21 14:09:06.942378] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620419, task_cnt=6, avg_time=8) [2025-04-21 14:09:06.942394] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620317, task_cnt=2, avg_time=55) [2025-04-21 14:09:06.942411] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=15] TIMER THREAD STAT: (thread_id=620395, task_cnt=2, avg_time=168) [2025-04-21 14:09:06.942427] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619604, task_cnt=1, avg_time=6) [2025-04-21 14:09:06.942445] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619568, task_cnt=1, avg_time=74) [2025-04-21 14:09:06.942463] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620394, task_cnt=1, avg_time=10232) [2025-04-21 14:09:06.942480] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=619600, task_cnt=1, avg_time=87165) [2025-04-21 14:09:06.942498] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619824, task_cnt=1, avg_time=8) [2025-04-21 14:09:06.942516] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=619990, task_cnt=1, avg_time=66074) [2025-04-21 14:09:06.942534] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=18] TIMER THREAD STAT: (thread_id=620116, task_cnt=1, avg_time=8) [2025-04-21 14:09:06.942552] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620175, task_cnt=1, avg_time=50500) [2025-04-21 14:09:06.942569] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=17] TIMER THREAD STAT: (thread_id=620254, task_cnt=1, avg_time=6) [2025-04-21 14:09:06.942587] INFO dump (ob_timer_monitor.cpp:200) [619610][ObTimer][T0][Y0-0000000000000000-0-0] [lt=16] TIMER THREAD STAT: (thread_id=620315, task_cnt=1, avg_time=123675) [2025-04-21 14:09:06.943172] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDF9-0-0] [lt=70] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:06.943847] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD92-0-0] [lt=22] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215742019902, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:06.943906] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD92-0-0] [lt=55] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215742021658, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:06.943946] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD92-0-0] [lt=38] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215742023097, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215742023094, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:06.950328] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=67] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:06.959370] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:06.959424] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:06.966346] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:06.992971] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:06.997889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:07.021367] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=22] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:07.021425] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=57] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:07.021414] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC0-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:07.021461] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC0-0-0] [lt=43] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:07.037715] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=54] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:07.055737] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=18] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:07.055860] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=72] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:07.055897] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=228, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:07.055982] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:07.056052] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:07.056076] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=27, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:07.066415] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.084051] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:07.084104] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.108107] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=42][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:07.126282] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:07.126328] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] try gc retain ctx [2025-04-21 14:09:07.126344] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:07.126395] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215746983493000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215737116906001, v:0}, keep_alive_scn_:{val:1745215741979953001, v:0}, update_ts_:1745215747125565}) [2025-04-21 14:09:07.127373] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215755197259000, latest_log_ts:{val:1745215738572266001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:07.141374] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:8784796}], scn_array=[cnt:1, {val:1745215746717354003, v:0}], curr_size=122, accum_size=1475, time_cost=31061) [2025-04-21 14:09:07.141439] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17367490}], scn_array=[cnt:1, {val:1745215746717354003, v:0}], curr_size=122, accum_size=610, time_cost=31138) [2025-04-21 14:09:07.142006] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65838844}], scn_array=[cnt:1, {val:1745215746983493001, v:0}], curr_size=113, accum_size=2111, time_cost=14471) [2025-04-21 14:09:07.142115] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3525) [2025-04-21 14:09:07.142178] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=2878, avg_log_submit_to_slide_time=2899) [2025-04-21 14:09:07.146223] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215747046535000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215747146163}, version_delta=99685) [2025-04-21 14:09:07.166513] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.182614] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=62] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215746983493000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199106, in_cluster_service=true, cluster_version={val:1745215746783586000, v:0}, min_cluster_version={val:1745215746783586000, v:0}, max_cluster_version={val:1745215746783586000, v:0}, get_cluster_version_err=0, cluster_version_delta=399013, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1271, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=84712736, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:07.184638] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=107] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3525) [2025-04-21 14:09:07.193151] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:07.198406] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:07.214093] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=346, get_gts_with_stc_cnt=30, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:07.214171] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=73] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:07.235484] WDIAG begin (ob_hashtable.h:954) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8A-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.238034] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8A-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254952788341, cache_obj->added_lc()=false, cache_obj->get_object_id()=709, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:07.251824] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC8-0-0] [lt=54] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:07.251894] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC8-0-0] [lt=61] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=73) [2025-04-21 14:09:07.266797] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.274152] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE04-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:07.274201] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE04-0-0] [lt=47] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:07.323754] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5E-0-0] [lt=15] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:07.323829] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5E-0-0] [lt=71] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:07.342459] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:07.346570] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:07.346626] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:07.346822] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:07.347025] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:07.347111] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:18, schedule:38, submit:8, rt:1205, total:1270) [2025-04-21 14:09:07.347188] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:07.347247] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:18, schedule:38, submit:8, device:1205, total:1270) [2025-04-21 14:09:07.347308] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:07.347380] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:578, total:592) [2025-04-21 14:09:07.347457] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:07.347496] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:578, total:592) [2025-04-21 14:09:07.347554] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:07.347581] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:07.366873] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.382067] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:07.382155] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.386706] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=56] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:07.387976] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:07.388080] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215741191562000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:07.388141] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=57] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215741191562000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1745215741191562000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:07.393299] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:07.399003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:07.410464] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:07.410528] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:07.410558] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:07.410595] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:07.410627] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:07.412125] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4445, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:07.412187] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1841) [2025-04-21 14:09:07.412203] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4443, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:07.412228] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:07.412247] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:07.412306] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:07.412346] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4545, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:07.412375] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:07.412415] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:07.412433] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4599, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:07.412453] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:07.421590] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=32] gc stale ls task succ [2025-04-21 14:09:07.433971] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:07.434259] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:07.434725] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:07.434795] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=58] temporary file module use no blocks [2025-04-21 14:09:07.434814] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:07.434837] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=20] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:07.434858] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254951984946, flush_io_finished_ret_:0, flush_io_finished_round_:139, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:07.448035] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0003-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.011978530883789062e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.818036847331255785e+02) [2025-04-21 14:09:07.448342] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8384, avg_group_log_size=493) [2025-04-21 14:09:07.448387] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8383) [2025-04-21 14:09:07.449831] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1335, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:07.449900] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=116, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:07.449956] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:07.449998] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1608, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:07.450024] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:07.450169] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:07.459583] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:07.459659] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.466974] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.474645] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.475251] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.475277] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.475319] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.490163] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8384) [2025-04-21 14:09:07.490275] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8384) [2025-04-21 14:09:07.490362] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=46, avg_log_gen_to_submit_time=63, avg_log_submit_to_flush_time=1537, avg_log_submit_to_slide_time=1561) [2025-04-21 14:09:07.490439] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8384, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:07.512130] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1841) [2025-04-21 14:09:07.512216] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=4525, avg_log_submit_to_slide_time=4546) [2025-04-21 14:09:07.512283] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:07.512316] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=4592, avg_log_submit_to_slide_time=4611) [2025-04-21 14:09:07.512379] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1841, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:07.512422] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:07.526667] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=93] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:07.526759] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3525, avg_group_log_size=352) [2025-04-21 14:09:07.526794] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:07.528303] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2819, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:07.528346] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3525) [2025-04-21 14:09:07.528377] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:07.528451] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:07.528493] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2981, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:07.528520] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:07.528593] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3525, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:07.567043] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.580679] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:07.584253] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:07.584311] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.585566] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:07.585638] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=62] temporary file module use no blocks [2025-04-21 14:09:07.585658] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:07.585751] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=90] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:07.585778] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254952135786, flush_io_finished_ret_:0, flush_io_finished_round_:139, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:07.593432] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:07.597623] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:07.599531] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:07.601515] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:07.601587] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=52] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=28) [2025-04-21 14:09:07.605418] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:07.605464] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:07.607260] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:07.607298] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:07.608759] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=2000000, clean_num=200000) [2025-04-21 14:09:07.610615] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:07.610701] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1841, avg_group_log_size=184) [2025-04-21 14:09:07.610737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1841) [2025-04-21 14:09:07.612349] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:07.617940] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=22] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:07.619176] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:07.619276] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215745589109000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:07.634035] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCB-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:07.648090] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] get number(ret=0, service_type_=0, range=1, base_id=1745215747647865000, start_id=1745215747647865000, end_id=1745215747647865001) [2025-04-21 14:09:07.651711] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD7-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.651711] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0186-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.653671] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0188-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.653679] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDD9-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.667111] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.670662] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0189-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.672410] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F018B-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.689037] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=30] log compressor cycles once. (ret=0, cost_time=1108, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017331712, fast_delete_log_mode=false) [2025-04-21 14:09:07.695216] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695278] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695292] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695325] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695479] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695508] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.695534] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.696025] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.696113] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.696164] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.696211] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=17] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:07.714681] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1745215747713731000, start_id=1745215747713731000, end_id=1745215747713731001) [2025-04-21 14:09:07.715029] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=74] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215747715010], gts:1745215747714803000, latest_srr:[mts=1745215747715010]}) [2025-04-21 14:09:07.721495] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=67] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:07.757053] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215747757047, bytes: 4873274, bw: 0.013462 MB/s, add_ts: 1007614, add_bytes: 14223 [2025-04-21 14:09:07.767208] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.789256] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=83] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:07.791548] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=52] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:07.793587] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:07.809279] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:07.814739] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:07.814797] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:07.826093] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:07.832704] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1745215747832698, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007610, add_bytes: 0 [2025-04-21 14:09:07.833328] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:07.833380] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:07.833399] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:07.833437] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:07.833463] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254952383563, flush_io_finished_ret_:0, flush_io_finished_round_:139, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:07.834336] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=50] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:07.835912] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F018D-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.836472] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0124-0-0] [lt=39][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=secure_file_priv) [2025-04-21 14:09:07.836716] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0124-0-0] [lt=46][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=external_user) [2025-04-21 14:09:07.837833] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F018F-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.838015] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD8F-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12274, add_timestamp:1745215747837998}) [2025-04-21 14:09:07.838440] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE11-0-0] [lt=26] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.838857] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE11-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747838833, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.838915] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE11-0-0] [lt=57] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215747837998}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747838833, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.853423] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8B-0-0] [lt=55] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215747853400}) [2025-04-21 14:09:07.853460] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE12-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.853538] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=88] new mysql sessid created(conn.sessid_=3221487806, support_ssl=false) [2025-04-21 14:09:07.853648] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] new mysql sessid created(conn.sessid_=3221487807, support_ssl=false) [2025-04-21 14:09:07.853657] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=50] sm conn init succ(conn.sessid_=3221487806, sess.client_addr_="127.0.0.1:38006") [2025-04-21 14:09:07.853706] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=40] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487806, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.853736] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487807, sess.client_addr_="127.0.0.1:38012") [2025-04-21 14:09:07.853766] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] accept one succ(*s={this:0x7f3bc7c1a030, session_id:3221487807, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.853825] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=49] new mysql sessid created(conn.sessid_=3221487808, support_ssl=false) [2025-04-21 14:09:07.853894] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] sm conn init succ(conn.sessid_=3221487808, sess.client_addr_="127.0.0.1:38028") [2025-04-21 14:09:07.853897] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE12-0-0] [lt=44] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747853870, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.853928] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487808, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.853937] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE12-0-0] [lt=39] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215747853400}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747853870, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.854002] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221487810, support_ssl=false) [2025-04-21 14:09:07.853996] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=249] new mysql sessid created(conn.sessid_=3221487809, support_ssl=false) [2025-04-21 14:09:07.854059] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] sm conn init succ(conn.sessid_=3221487810, sess.client_addr_="127.0.0.1:38040") [2025-04-21 14:09:07.854062] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221487809, sess.client_addr_="127.0.0.1:38024") [2025-04-21 14:09:07.854084] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c1ad70, session_id:3221487810, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854094] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487809, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854112] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=124] new mysql sessid created(conn.sessid_=3221487811, support_ssl=false) [2025-04-21 14:09:07.854147] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37] new mysql sessid created(conn.sessid_=3221487812, support_ssl=false) [2025-04-21 14:09:07.854175] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=33] sm conn init succ(conn.sessid_=3221487811, sess.client_addr_="127.0.0.1:38054") [2025-04-21 14:09:07.854203] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3bc7c1c030, session_id:3221487811, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854205] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=28] sm conn init succ(conn.sessid_=3221487812, sess.client_addr_="127.0.0.1:38036") [2025-04-21 14:09:07.854237] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=28] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487812, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854285] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=35] new mysql sessid created(conn.sessid_=3221487813, support_ssl=false) [2025-04-21 14:09:07.854342] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221487813, sess.client_addr_="127.0.0.1:38066") [2025-04-21 14:09:07.854345] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] new mysql sessid created(conn.sessid_=3221487814, support_ssl=false) [2025-04-21 14:09:07.854373] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=28] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487813, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854412] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221487815, support_ssl=false) [2025-04-21 14:09:07.854426] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] sm conn init succ(conn.sessid_=3221487814, sess.client_addr_="127.0.0.1:38074") [2025-04-21 14:09:07.854460] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] sm conn init succ(conn.sessid_=3221487815, sess.client_addr_="127.0.0.1:38088") [2025-04-21 14:09:07.854464] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] accept one succ(*s={this:0x7f3bc7c1cd70, session_id:3221487814, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854485] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3bc7c1e030, session_id:3221487815, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854517] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=38] new mysql sessid created(conn.sessid_=3221487816, support_ssl=false) [2025-04-21 14:09:07.854568] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221487816, sess.client_addr_="127.0.0.1:38102") [2025-04-21 14:09:07.854588] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221487817, support_ssl=false) [2025-04-21 14:09:07.854592] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c1ed70, session_id:3221487816, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854630] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487817, sess.client_addr_="127.0.0.1:38112") [2025-04-21 14:09:07.854653] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3bc7c20030, session_id:3221487817, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:227}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.854698] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221487818, support_ssl=false) [2025-04-21 14:09:07.854775] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487818, sess.client_addr_="127.0.0.1:38120") [2025-04-21 14:09:07.854805] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] accept one succ(*s={this:0x7f3bc7c20d70, session_id:3221487818, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:228}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855057] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221487819, support_ssl=false) [2025-04-21 14:09:07.855151] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221487820, support_ssl=false) [2025-04-21 14:09:07.855157] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] sm conn init succ(conn.sessid_=3221487819, sess.client_addr_="127.0.0.1:38122") [2025-04-21 14:09:07.855207] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221487820, sess.client_addr_="127.0.0.1:38128") [2025-04-21 14:09:07.855201] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=38] accept one succ(*s={this:0x7f3c20ef6030, session_id:3221487819, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:229}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855231] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c22030, session_id:3221487820, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:230}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855241] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487821, support_ssl=false) [2025-04-21 14:09:07.855320] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37] sm conn init succ(conn.sessid_=3221487821, sess.client_addr_="127.0.0.1:38134") [2025-04-21 14:09:07.855365] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=27] accept one succ(*s={this:0x7f3bc7c22d70, session_id:3221487821, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:231}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855406] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221487822, support_ssl=false) [2025-04-21 14:09:07.855451] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] sm conn init succ(conn.sessid_=3221487822, sess.client_addr_="127.0.0.1:38142") [2025-04-21 14:09:07.855474] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3bc7c24030, session_id:3221487822, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:232}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855508] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487823, support_ssl=false) [2025-04-21 14:09:07.855546] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487823, sess.client_addr_="127.0.0.1:38144") [2025-04-21 14:09:07.855569] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3bc7c24d70, session_id:3221487823, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:233}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.855621] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855645] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855659] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=22] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855689] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=31] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855697] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855704] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=40] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855732] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855752] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=14] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855750] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=33] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855772] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855798] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855813] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=12] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855804] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB4-0-0] [lt=55] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.855839] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855828] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB6-0-0] [lt=36] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.855845] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB1-0-0] [lt=50] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.855870] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855897] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855915] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.855947] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.855965] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856014] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=34] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856029] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856045] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=12] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856050] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=26] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856065] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856082] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=12] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856145] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856178] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856219] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856245] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856257] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856276] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856333] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856358] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856370] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856403] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856439] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:07.856464] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=19] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:07.856489] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4063, offset=75375}, end_cursor:ObLogCursor{file_id=3, log_id=4064, offset=75681}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77548050, len:2449, log_data_len:306, seq:4063, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:07.856801] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB1-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487822, proxy_sessid=0, client_sessid=3221487822, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.856888] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB6-0-0] [lt=35] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487820, proxy_sessid=0, client_sessid=3221487820, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.856924] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB2-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.856971] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB4-0-0] [lt=35] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487821, proxy_sessid=0, client_sessid=3221487821, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.857044] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB7-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.857127] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB5-0-0] [lt=73] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.857261] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0129-0-0] [lt=37] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11018, add_timestamp:1745215747857244}) [2025-04-21 14:09:07.857339] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA5-0-0] [lt=12] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11037, add_timestamp:1745215747857334}) [2025-04-21 14:09:07.857558] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE68-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:07.857663] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE13-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11018, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.857663] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE68-0-0] [lt=69] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215747214119004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215747214119004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:07.857702] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB2-0-0] [lt=17] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487819, proxy_sessid=0, client_sessid=3221487819, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.857735] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=10][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c22030, session_id:3221487820, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:230}, err:5, last_decode_time:1745215747854903, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:289, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.857782] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=39] kill and revert session(conn.sessid_=3221487820, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.857814] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB3-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.857898] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB5-0-0] [lt=18] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487817, proxy_sessid=0, client_sessid=3221487817, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.857846] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] sock ref clean, do destroy(*s={this:0x7f3bc7c22030, session_id:3221487820, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:230}, err:5, last_decode_time:1745215747854903, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:289, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.857967] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=104] unlock session of tenant(conn.sessid_=3221487820, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.857992] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487820, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF0129-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:184, rec_:184, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:5, seq_:7}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.858026] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB6-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.858054] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=41] free session successfully(sessid=3221487820) [2025-04-21 14:09:07.858087] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=30] mark session id unused(sessid=3221487820) [2025-04-21 14:09:07.858066] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB7-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487818, proxy_sessid=0, client_sessid=3221487818, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.858229] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB8-0-0] [lt=56] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.858293] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:07.858308] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=13][errcode=0] server close connection(sessid=3221487822, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:07.858278] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c24030, session_id:3221487822, trace_id:YB420B1D7AB6-00063343B4AF012A-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:232}, err:5, last_decode_time:1745215747857362, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:615, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.858336] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=25] quit [2025-04-21 14:09:07.858356] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=18][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.858377] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=20][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.858363] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=73] kill and revert session(conn.sessid_=3221487822, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.858395] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.858416] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=19][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.858399] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] can close safely, do destroy(*s={this:0x7f3bc7c24030, session_id:3221487822, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:232}, err:5, last_decode_time:1745215747857362, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:620, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.858433] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.858447] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012A-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.858460] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.858456] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487822, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.858522] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=51] free session successfully(sessid=3221487822) [2025-04-21 14:09:07.858558] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487822) [2025-04-21 14:09:07.858517] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=59] connection close(sessid=3221487822, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDC3-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:510, rec_:510, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:12}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:13}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.858567] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB3-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487816, proxy_sessid=0, client_sessid=3221487816, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.858615] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215747858611}) [2025-04-21 14:09:07.858654] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=26] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215747858652}) [2025-04-21 14:09:07.858673] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB4-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.858694] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=21] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12084, add_timestamp:1745215747858681}) [2025-04-21 14:09:07.858745] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=38] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215747858742}) [2025-04-21 14:09:07.858813] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB6-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487815, proxy_sessid=0, client_sessid=3221487815, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.858925] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB7-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.859129] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB8-0-0] [lt=30] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487814, proxy_sessid=0, client_sessid=3221487814, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.859254] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB9-0-0] [lt=45] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.859451] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB4-0-0] [lt=36] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487811, proxy_sessid=0, client_sessid=3221487811, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.859557] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB5-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.859689] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB7-0-0] [lt=25] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487813, proxy_sessid=0, client_sessid=3221487813, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.859824] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB8-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.860128] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDB9-0-0] [lt=28] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487810, proxy_sessid=0, client_sessid=3221487810, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.860249] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBA-0-0] [lt=46] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.860315] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB5-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487812, proxy_sessid=0, client_sessid=3221487812, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.860425] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB6-0-0] [lt=34] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.860603] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB8-0-0] [lt=25] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487809, proxy_sessid=0, client_sessid=3221487809, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.860712] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB9-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.860838] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=69][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c22d70, session_id:3221487821, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:231}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:290, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.860883] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA6-0-0] [lt=31] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215747860878}) [2025-04-21 14:09:07.860907] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=59] kill and revert session(conn.sessid_=3221487821, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.860925] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA6-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215747860924}) [2025-04-21 14:09:07.861126] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE68-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1745215747860613000, start_id=1745215747860613000, end_id=1745215747860613001) [2025-04-21 14:09:07.861236] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB6-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487823, proxy_sessid=0, client_sessid=3221487823, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.861243] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBA-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487807, proxy_sessid=0, client_sessid=3221487807, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.861348] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB7-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:07.861530] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDB9-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487808, proxy_sessid=0, client_sessid=3221487808, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.861640] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0192-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.861816] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8C-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215747861811}) [2025-04-21 14:09:07.861826] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD90-0-0] [lt=13][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215747861821}) [2025-04-21 14:09:07.861859] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD90-0-0] [lt=32][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215747861821}) [2025-04-21 14:09:07.861881] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD90-0-0] [lt=21][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864641, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.861944] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=54][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747861936}) [2025-04-21 14:09:07.861984] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=38][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747861936}) [2025-04-21 14:09:07.862023] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=37][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.862080] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=37][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747862078}) [2025-04-21 14:09:07.862085] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=16][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747862080}) [2025-04-21 14:09:07.862102] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=20][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747862078}) [2025-04-21 14:09:07.862122] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=37][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747862080}) [2025-04-21 14:09:07.862120] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=18][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.862138] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=14][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.862149] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620054][T1_L0_G0][T1][YB420B1D7AB6-00063343B4BEFD8E-0-0] [lt=17] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215747862145}) [2025-04-21 14:09:07.862174] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=23][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747862172}) [2025-04-21 14:09:07.862188] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=13][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747862172}) [2025-04-21 14:09:07.862201] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=12][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.862233] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=24][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215747862231}) [2025-04-21 14:09:07.862257] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=24][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215747862231}) [2025-04-21 14:09:07.862271] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620058][T1_L0_G0][T1][YB420B1D7AB6-00063343B5FEFD8C-0-0] [lt=13][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732865587, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.862539] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB7-0-0] [lt=25] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487806, proxy_sessid=0, client_sessid=3221487806, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:07.863307] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=14][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747863303}) [2025-04-21 14:09:07.863349] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=40][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747863303}) [2025-04-21 14:09:07.863365] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=16][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.863398] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=23][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747863396}) [2025-04-21 14:09:07.863386] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD8E-0-0] [lt=51] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12325, add_timestamp:1745215747863380}) [2025-04-21 14:09:07.863389] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=47][errcode=0] server close connection(sessid=3221487821, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:07.863927] INFO [SERVER] process (obmp_quit.h:56) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=534] quit [2025-04-21 14:09:07.863959] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=28][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.863990] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=28][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.864016] WDIAG [SERVER] response (obmp_base.cpp:87) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=25][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.864046] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=27][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.864078] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=27][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.863639] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=46] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215747863636}) [2025-04-21 14:09:07.865200] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=1525][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12142, add_timestamp:1745215747865194}) [2025-04-21 14:09:07.865237] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=37][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12142, add_timestamp:1745215747865194}) [2025-04-21 14:09:07.865260] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=21][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12142, vtable_locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732863869, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.865317] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=37] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215747865314}) [2025-04-21 14:09:07.865348] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=23][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12072, add_timestamp:1745215747865346}) [2025-04-21 14:09:07.865373] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=24][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12072, add_timestamp:1745215747865346}) [2025-04-21 14:09:07.865387] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=12][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12072, vtable_locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864780, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.865423] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=26][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12068, add_timestamp:1745215747865421}) [2025-04-21 14:09:07.865436] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=13][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12068, add_timestamp:1745215747865421}) [2025-04-21 14:09:07.865450] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD90-0-0] [lt=13][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12068, vtable_locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732864838, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.864107] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620056][T1_L0_G0][T1][YB420B1D7AB6-00063343B60EFD89-0-0] [lt=27][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.865634] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620056][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=1525][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.865616] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] can close safely, do destroy(*s={this:0x7f3bc7c22d70, session_id:3221487821, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:231}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:295, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.865691] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=49] unlock session of tenant(conn.sessid_=3221487821, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.865716] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC5-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215747865707}) [2025-04-21 14:09:07.865718] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487821, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA5-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:185, rec_:185, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:6}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.865789] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487821) [2025-04-21 14:09:07.865827] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487821) [2025-04-21 14:09:07.865809] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=80][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1ed70, session_id:3221487816, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215747858480, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.865892] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=67] kill and revert session(conn.sessid_=3221487816, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.866055] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=41] sock ref clean, do destroy(*s={this:0x7f3bc7c1ed70, session_id:3221487816, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215747858480, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.866141] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=61] unlock session of tenant(conn.sessid_=3221487816, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.866201] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487816) [2025-04-21 14:09:07.866223] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487816) [2025-04-21 14:09:07.866181] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=38] connection close(sessid=3221487816, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA6-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.866458] WDIAG [SERVER] inner_get_next_row (ob_information_query_response_time.cpp:107) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD8E-0-0] [lt=39][errcode=-4008] fail to execute(ret=-4008) [2025-04-21 14:09:07.863419] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=20][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747863396}) [2025-04-21 14:09:07.866546] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620052][T1_L0_G0][T1][YB420B1D7AB6-00063343B68EFD8E-0-0] [lt=3124][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.863827] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620070][T1_L0_G0][T1][YB420B1D7AB6-00063343B5EEFD88-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215747863823}) [2025-04-21 14:09:07.867337] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD90-0-0] [lt=36][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:07.864165] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=55][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747864161}) [2025-04-21 14:09:07.867522] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=3355][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215747864161}) [2025-04-21 14:09:07.867508] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487809, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867553] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=29][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858644, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.867585] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=65] kill and revert session(conn.sessid_=3221487809, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.867608] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=32][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747867604}) [2025-04-21 14:09:07.867624] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=16][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215747867604}) [2025-04-21 14:09:07.864519] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=53][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1e030, session_id:3221487815, trace_id:YB420B1D7AB6-00063343B6AEFD96-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215747863966, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867638] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=13][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215732858723, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.867648] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] sock ref clean, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487809, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867657] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=3124] kill and revert session(conn.sessid_=3221487815, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.867689] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] unlock session of tenant(conn.sessid_=3221487809, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.863410] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620063][T1_L0_G0][T1][YB420B1D7AB6-00063343B6CEFD8A-0-0] [lt=27] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215747863405}) [2025-04-21 14:09:07.867707] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16] connection close(sessid=3221487809, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6CEFD88-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.867767] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487806, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215747865050, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867797] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] kill and revert session(conn.sessid_=3221487806, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.867813] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487806, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215747865050, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867846] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] unlock session of tenant(conn.sessid_=3221487806, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.867860] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487806, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDC5-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:25, seq_:31}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:32}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.867851] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=73][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1ad70, session_id:3221487810, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867910] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=49] kill and revert session(conn.sessid_=3221487810, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.867935] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] sock ref clean, do destroy(*s={this:0x7f3bc7c1ad70, session_id:3221487810, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.867953] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487809) [2025-04-21 14:09:07.867967] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=47] free session successfully(sessid=3221487806) [2025-04-21 14:09:07.867980] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=26] mark session id unused(sessid=3221487809) [2025-04-21 14:09:07.867983] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] unlock session of tenant(conn.sessid_=3221487810, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.867996] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=29] mark session id unused(sessid=3221487806) [2025-04-21 14:09:07.867988] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1c030, session_id:3221487811, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215747861737, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868023] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=49][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487813, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868032] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=38] kill and revert session(conn.sessid_=3221487811, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.868050] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] kill and revert session(conn.sessid_=3221487813, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.868052] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487810) [2025-04-21 14:09:07.868008] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487810, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4BEFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.868051] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] sock ref clean, do destroy(*s={this:0x7f3bc7c1c030, session_id:3221487811, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215747861737, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868066] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=13] mark session id unused(sessid=3221487810) [2025-04-21 14:09:07.868090] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487811, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.868110] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=15] sock ref clean, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487813, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868122] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487811) [2025-04-21 14:09:07.868107] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] connection close(sessid=3221487811, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5EEFD88-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.868136] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=14] mark session id unused(sessid=3221487811) [2025-04-21 14:09:07.868148] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487813, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.864545] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=50][errcode=0] server close connection(sessid=3221487815, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:07.868162] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=14] connection close(sessid=3221487813, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B63EFD90-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.868198] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=10] free session successfully(sessid=3221487813) [2025-04-21 14:09:07.868192] INFO [SERVER] process (obmp_quit.h:56) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=3637] quit [2025-04-21 14:09:07.868210] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12] mark session id unused(sessid=3221487813) [2025-04-21 14:09:07.868213] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=18][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.868206] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487812, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868250] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37] kill and revert session(conn.sessid_=3221487812, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.868243] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=28][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.868276] WDIAG [SERVER] response (obmp_base.cpp:87) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=31][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.868302] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] sock ref clean, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487812, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215747859546, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.868303] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=25][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.868334] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=27][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.868339] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] unlock session of tenant(conn.sessid_=3221487812, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.868360] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD96-0-0] [lt=23][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.868380] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.868360] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] connection close(sessid=3221487812, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5FEFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.868395] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487812) [2025-04-21 14:09:07.865030] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE13-0-0] [lt=34] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11018, locations=[{table_id:11018, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747864971, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.868419] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] mark session id unused(sessid=3221487812) [2025-04-21 14:09:07.868426] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE13-0-0] [lt=3393] success to process renew task(task={tenant_id:1, table_id:11018, add_timestamp:1745215747857244}, locations=[{table_id:11018, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747864971, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.868494] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE14-0-0] [lt=42] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11037, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.868497] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620060][T1_L0_G0][T1][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=19] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:07.868555] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620060][T1_L0_G0][T1001][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=24] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:07.868592] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620060][T1_L0_G0][T1002][YB420B1D7AB6-00063343B65EFD8C-0-0] [lt=24] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:07.868728] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.869033] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE14-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11037, locations=[{table_id:11037, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747868989, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.869070] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE14-0-0] [lt=36] success to process renew task(task={tenant_id:1, table_id:11037, add_timestamp:1745215747857334}, locations=[{table_id:11037, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747868989, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.869115] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE15-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869106, sql_renew_time:1745215747869106, is_mark_fail:false}]) [2025-04-21 14:09:07.869138] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE15-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215747858611}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869106, sql_renew_time:1745215747869106, is_mark_fail:false}]) [2025-04-21 14:09:07.869173] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE16-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869166, sql_renew_time:1745215747869166, is_mark_fail:false}]) [2025-04-21 14:09:07.869217] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE16-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215747858652}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869166, sql_renew_time:1745215747869166, is_mark_fail:false}]) [2025-04-21 14:09:07.869267] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE17-0-0] [lt=32] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12084, locations=[{table_id:12084, partition_id:12084, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869257, sql_renew_time:1745215747869257, is_mark_fail:false}]) [2025-04-21 14:09:07.869290] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE17-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12084, add_timestamp:1745215747858681}, locations=[{table_id:12084, partition_id:12084, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869257, sql_renew_time:1745215747869257, is_mark_fail:false}]) [2025-04-21 14:09:07.869324] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE18-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869317, sql_renew_time:1745215747869317, is_mark_fail:false}]) [2025-04-21 14:09:07.869349] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE18-0-0] [lt=25] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215747858742}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869317, sql_renew_time:1745215747869317, is_mark_fail:false}]) [2025-04-21 14:09:07.869382] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE19-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869375, sql_renew_time:1745215747869375, is_mark_fail:false}]) [2025-04-21 14:09:07.869403] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE19-0-0] [lt=20] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215747860878}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869375, sql_renew_time:1745215747869375, is_mark_fail:false}]) [2025-04-21 14:09:07.869436] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1A-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869430, sql_renew_time:1745215747869430, is_mark_fail:false}]) [2025-04-21 14:09:07.869458] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1A-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215747860924}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869430, sql_renew_time:1745215747869430, is_mark_fail:false}]) [2025-04-21 14:09:07.869485] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1B-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.870141] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8C-0-0] [lt=36][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:07.870578] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c1cd70, session_id:3221487814, trace_id:YB420B1D7AB6-00063343B5BEFDC6-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215747870404, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.870610] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=36][errcode=0] server close connection(sessid=3221487814, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:07.870652] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=39] quit [2025-04-21 14:09:07.870667] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=13][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.870653] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=65] kill and revert session(conn.sessid_=3221487814, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.870700] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=31][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.870719] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.870737] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.870757] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.870775] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC6-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.870791] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.870847] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.870883] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=35][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.870925] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=31][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.870902] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=39] can close safely, do destroy(*s={this:0x7f3bc7c1e030, session_id:3221487815, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215747863966, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:476, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.870938] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=13][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.870955] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=14][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.870967] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.870963] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=45] unlock session of tenant(conn.sessid_=3221487815, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.870981] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.870993] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871008] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871019] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871033] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.870988] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487815, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDC4-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.871044] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871053] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487815) [2025-04-21 14:09:07.871069] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=21][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871084] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=30] mark session id unused(sessid=3221487815) [2025-04-21 14:09:07.871086] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871106] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871125] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871124] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=74][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c20030, session_id:3221487817, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.871145] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871163] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871170] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=39] kill and revert session(conn.sessid_=3221487817, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.871183] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871202] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871222] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871238] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871242] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] sock ref clean, do destroy(*s={this:0x7f3bc7c20030, session_id:3221487817, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.871257] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871274] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871289] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=13][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871288] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=32] unlock session of tenant(conn.sessid_=3221487817, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.871301] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871321] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871303] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=14] connection close(sessid=3221487817, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B68EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.871338] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871359] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871376] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871371] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487817) [2025-04-21 14:09:07.871396] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871398] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25] mark session id unused(sessid=3221487817) [2025-04-21 14:09:07.871415] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871435] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871452] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871474] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871491] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871510] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871527] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871547] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871563] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871583] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871599] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871619] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871630] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871651] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871667] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871687] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871704] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871723] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871739] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871759] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871776] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871796] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871813] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871832] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871849] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871846] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0193-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:07.871868] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871885] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871904] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871920] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871940] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871956] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.871976] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.871992] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872011] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872028] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872047] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872064] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872083] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872099] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872118] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872134] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872149] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872160] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872175] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=13][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872156] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1B-0-0] [lt=18] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872132, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.872186] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872193] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1B-0-0] [lt=42] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215747861811}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872132, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.872202] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872214] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872228] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872226] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1C-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.872240] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872255] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872266] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872281] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872299] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872315] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872303] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=38][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c20d70, session_id:3221487818, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:228}, err:5, last_decode_time:1745215747861737, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.872326] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872343] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=14][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872347] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=36] kill and revert session(conn.sessid_=3221487818, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.872356] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872363] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] sock ref clean, do destroy(*s={this:0x7f3bc7c20d70, session_id:3221487818, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:228}, err:5, last_decode_time:1745215747861737, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.872371] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872382] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872398] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872400] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] unlock session of tenant(conn.sessid_=3221487818, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.872415] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872434] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872422] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] connection close(sessid=3221487818, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B65EFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.872452] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872468] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=14][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872480] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872494] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872489] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487818) [2025-04-21 14:09:07.872511] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872521] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=30] mark session id unused(sessid=3221487818) [2025-04-21 14:09:07.872510] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1C-0-0] [lt=16] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872498, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.872538] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=23][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872549] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=11][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872542] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1C-0-0] [lt=30] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215747862145}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872498, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.872565] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=13][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872576] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1D-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12325, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.872589] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=22][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872611] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=19][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872630] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872645] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872656] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872671] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872646] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4064, offset=75681}, end_cursor:ObLogCursor{file_id=3, log_id=4065, offset=75978}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7754c050, len:2143, log_data_len:297, seq:4064, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:07.872682] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872697] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=12][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872708] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=10][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872728] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872744] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872764] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872780] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872800] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872818] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872838] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872855] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872874] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872890] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=15][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872910] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872926] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872946] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=17][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.872964] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] string accuracy check failed(cast_ret=-5167, ret=0, warning=-5167, is_oracle=false, meta={type:"VARCHAR", collation:"utf8mb4_general_ci", coercibility:"INVALID"}) [2025-04-21 14:09:07.872984] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12031) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=18][errcode=0] char type length is too long(max_accuracy_len=8, trunc_len_char=11) [2025-04-21 14:09:07.873025] WDIAG [SQL] string_length_check (ob_datum_cast.cpp:12044) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012B-0-0] [lt=16][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:07.872988] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE68-0-0] [lt=75] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:07.873031] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1D-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12325, locations=[{table_id:12325, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872991, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873065] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1D-0-0] [lt=34] success to process renew task(task={tenant_id:1, table_id:12325, add_timestamp:1745215747863380}, locations=[{table_id:12325, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872991, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873095] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE68-0-0] [lt=77] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215747214119004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215747214119004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:07.873111] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1E-0-0] [lt=32] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.873502] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1E-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873490, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873530] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1E-0-0] [lt=27] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215747863405}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873490, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873571] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1F-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873563, sql_renew_time:1745215747873563, is_mark_fail:false}]) [2025-04-21 14:09:07.873593] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE1F-0-0] [lt=22] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215747863636}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873563, sql_renew_time:1745215747873563, is_mark_fail:false}]) [2025-04-21 14:09:07.873625] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE20-0-0] [lt=23] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.873815] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE20-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873806, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873842] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE20-0-0] [lt=25] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215747863823}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873806, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.873877] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE21-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873870, sql_renew_time:1745215747873870, is_mark_fail:false}]) [2025-04-21 14:09:07.873900] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE21-0-0] [lt=22] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215747865314}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747873870, sql_renew_time:1745215747873870, is_mark_fail:false}]) [2025-04-21 14:09:07.873930] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE22-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:07.874229] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE22-0-0] [lt=17] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747874219, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.874261] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE22-0-0] [lt=30] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215747865707}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747874219, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:07.875344] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620063][T1_L0_G0][T1][YB420B1D7AB6-00063343B6CEFD8A-0-0] [lt=4303][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:07.875588] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=46] can close safely, do destroy(*s={this:0x7f3bc7c1cd70, session_id:3221487814, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215747870404, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:659, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.875667] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=53] unlock session of tenant(conn.sessid_=3221487814, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.875693] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487814, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B72EFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.875779] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=24] free session successfully(sessid=3221487814) [2025-04-21 14:09:07.875820] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] mark session id unused(sessid=3221487814) [2025-04-21 14:09:07.876478] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=17][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:07.876506] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=26] quit [2025-04-21 14:09:07.876522] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.876505] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:07.876536] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=14][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.876550] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=13][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.876546] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] kill and revert session(conn.sessid_=3221487807, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.876564] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=12][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.876565] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] can close safely, do destroy(*s={this:0x7f3bc7c1a030, session_id:3221487807, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:218}, err:5, last_decode_time:1745215747874681, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:798, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.876580] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.876594] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC7-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.876601] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] unlock session of tenant(conn.sessid_=3221487807, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.876609] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.876618] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] connection close(sessid=3221487807, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6CEFD8A-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.876685] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12] free session successfully(sessid=3221487807) [2025-04-21 14:09:07.876700] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=14] mark session id unused(sessid=3221487807) [2025-04-21 14:09:07.882227] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:07.882286] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.889356] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:07.892352] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215747214119003, v:0}, new_max_version={val:1745215747214119003, v:0}, last_min_version={val:1745215747214119001, v:0}, last_max_version={val:1745215747214119001, v:0}, total_time_us=5429, delta_us=678228) [2025-04-21 14:09:07.892416] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=60] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215747214119003, v:0}, min_version={val:1745215747214119003, v:0}, max_version={val:1745215747214119003, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:07.901333] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=61] LogLoopThread round_cost_time(us)(round_cost_time=28) [2025-04-21 14:09:07.904850] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5A-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:07.904917] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5A-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:07.905212] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=32][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:07.905283] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=61] kill and revert session(conn.sessid_=3221487819, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.905301] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=44][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:07.905359] INFO [SERVER] process (obmp_quit.h:56) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=52] quit [2025-04-21 14:09:07.905392] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=29][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:07.905421] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=28][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:07.905447] WDIAG [SERVER] response (obmp_base.cpp:87) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=24][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:07.905467] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:07.905490] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=20][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.905510] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8C-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.905535] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620066][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:07.905685] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] can close safely, do destroy(*s={this:0x7f3c20ef6030, session_id:3221487819, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:229}, err:5, last_decode_time:1745215747905138, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:233, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:07.905746] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=45] unlock session of tenant(conn.sessid_=3221487819, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.905769] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487819, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF012B-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:123, rec_:123, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:1, seq_:3}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:4}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:5}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:07.905821] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=1] free session successfully(sessid=3221487819) [2025-04-21 14:09:07.905837] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=2] kill and revert session(conn.sessid_=3221487808, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:07.905858] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36] mark session id unused(sessid=3221487819) [2025-04-21 14:09:07.905896] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] sock ref clean, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487808, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215747860613, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:07.905933] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] unlock session of tenant(conn.sessid_=3221487808, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:07.905952] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] connection close(sessid=3221487808, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD90-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:07.905996] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487808) [2025-04-21 14:09:07.906017] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=20] mark session id unused(sessid=3221487808) [2025-04-21 14:09:07.958765] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=49] current monitor number(seq_=-1) [2025-04-21 14:09:07.959811] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:07.959862] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:07.968796] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:07.993737] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:08.009848] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43594727424, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:08.026000] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:08.037867] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=53] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:08.040750] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFE08-0-0] [lt=206] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:09:08.068891] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.084469] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:08.084539] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.168970] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.185795] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:09:08.188312] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4119) [2025-04-21 14:09:08.188444] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=94] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=2570, avg_log_submit_to_slide_time=2599) [2025-04-21 14:09:08.193922] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=83] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:08.210438] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43594727424, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:08.215300] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=36] ts response task statistics(alloc_count=3102, free_count=1550) [2025-04-21 14:09:08.215402] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=80] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:08.242229] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012C-0-0] [lt=15][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.260938] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26238527}], scn_array=[cnt:1, {val:1745215748215041000, v:0}], curr_size=122, accum_size=5906, time_cost=25925) [2025-04-21 14:09:08.269156] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=204][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.276847] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE05-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:08.276930] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE05-0-0] [lt=79] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:08.288774] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0011-0-0] [lt=39] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215748286177, can_tenant_elr:true}) [2025-04-21 14:09:08.291041] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=104] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26243334, this={dio_aligned_buf:{buf_write_offset:851, buf_padding_size:3245, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:6212, truncate_used_ts:2546}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26243072, buf_len=589, total_write_size=86141, total_write_size_after_dio=782336, ob_pwrite_used_ts=290962, count=170, each_pwrite_cost=1711) [2025-04-21 14:09:08.325596] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5F-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:08.325672] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE5F-0-0] [lt=72] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:08.348662] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS SERVER] net_in=17kB/s, net_out=17kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:08.348740] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:08.348921] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:08.349142] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:08.349238] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:23, schedule:67, submit:9, rt:5279, total:5380) [2025-04-21 14:09:08.349330] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:08.349406] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:23, schedule:67, submit:9, device:5279, total:5380) [2025-04-21 14:09:08.349468] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:08.349543] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:876, total:918) [2025-04-21 14:09:08.349621] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:08.349658] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:876, total:918) [2025-04-21 14:09:08.349717] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:08.349743] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:08.369228] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.382411] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:08.382498] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.394067] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:08.405033] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:08.405092] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=53] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:08.411069] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=93] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43594727424, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:08.411212] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:08.411288] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:08.411327] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:08.411363] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:08.411391] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:08.412896] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1633, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:08.412954] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:08.412979] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1665, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:08.413056] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:08.413066] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:08.413117] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1767, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:08.413156] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:08.413211] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:08.413238] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1840, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:08.413263] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:08.420017] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:09:08.421686] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:08.434462] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=59] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:08.434819] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:08.451458] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=3090, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:08.451544] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=68] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=115, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:08.451612] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:08.451673] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=4499, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:08.451720] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:08.460027] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:08.460120] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=84] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.469299] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=80][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.474480] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.474926] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.475004] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.475286] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=55] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.476663] WDIAG [SERVER] inner_get_next_row (ob_information_query_response_time.cpp:107) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD8E-0-0] [lt=47][errcode=-4008] fail to execute(ret=-4008) [2025-04-21 14:09:08.478459] WDIAG [SERVER] inner_get_next_row (ob_information_query_response_time.cpp:107) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD8E-0-0] [lt=46][errcode=-4008] fail to execute(ret=-4008) [2025-04-21 14:09:08.481506] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=2] quit [2025-04-21 14:09:08.481546] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=37][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:08.481516] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=2] kill and revert session(conn.sessid_=3221487823, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:08.481565] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:08.481585] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=18][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:08.481603] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:08.481625] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:08.481643] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012E-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:08.481662] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:08.489226] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8973, avg_group_log_size=498) [2025-04-21 14:09:08.489275] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8973) [2025-04-21 14:09:08.491354] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8384) [2025-04-21 14:09:08.491451] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8384) [2025-04-21 14:09:08.491516] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=690, avg_log_gen_to_submit_time=713, avg_log_submit_to_flush_time=3781, avg_log_submit_to_slide_time=3807) [2025-04-21 14:09:08.491577] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8384, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:08.513102] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:08.513186] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1794, avg_log_submit_to_slide_time=1819) [2025-04-21 14:09:08.513247] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:08.513252] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:08.513300] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:08.513330] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1782, avg_log_submit_to_slide_time=1797) [2025-04-21 14:09:08.513362] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:08.527404] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:08.527490] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=70] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2025-04-21 14:09:08.527523] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:08.529102] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2541, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:08.529137] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3533) [2025-04-21 14:09:08.529169] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=82, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:08.529239] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:08.529296] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2751, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:08.529333] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=74, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:08.529416] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3533, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:08.557527] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=40] clear dtl interm result cost(us)(clear_cost=370, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:08.566769] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=33] ====== traversal_flush timer task ====== [2025-04-21 14:09:08.566937] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA1-0-0] [lt=48] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215748215041001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:08.567141] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA1-0-0] [lt=160] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:08.567218] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA1-0-0] [lt=74] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:08.569384] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.570471] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:09:08.570539] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=57] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:08.580764] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=63] gc stale ls task succ [2025-04-21 14:09:08.584674] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:08.584728] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.585495] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=59] submit log success(service_type_=0, last_id=1745215765197259000, limited_id=1745215765197259000) [2025-04-21 14:09:08.585536] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] submit log with lock success(service_type_=0, last_id=1745215765197259000, limited_id=1745215765197259000) [2025-04-21 14:09:08.587498] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215765197259000, latest_scn={val:1745215748585280001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:08.587595] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=94] handle submit callback(service_type_=0, success=true, used_ts=2100, log_ts={val:1745215748585280001, v:0}, limited_id=1745215765197259000) [2025-04-21 14:09:08.587622] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=25] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:08.587649] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=26] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:08.588194] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0117-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1745215748587416000, start_id=1745215748587416000, end_id=1745215748587416001) [2025-04-21 14:09:08.594232] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:08.597744] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:08.605137] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:08.605185] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:08.606929] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:08.606969] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:08.611336] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:08.611406] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:08.611440] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:08.611679] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=91] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:08.612577] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:09:08.612628] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=43] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:08.612692] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:08.613160] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:08.649609] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0009-0-0] [lt=46] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.011978530883789062e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.818036847331255785e+02) [2025-04-21 14:09:08.651919] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:08.654498] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=52] can close safely, do destroy(*s={this:0x7f3bc7c24d70, session_id:3221487823, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:233}, err:5, last_decode_time:1745215748481076, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:1109, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:08.654580] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63] unlock session of tenant(conn.sessid_=3221487823, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:08.654610] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] connection close(sessid=3221487823, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B61EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:999, rec_:999, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:5, seq_:7}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:37, seq_:45}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:46}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:08.654699] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487823) [2025-04-21 14:09:08.654740] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=39] mark session id unused(sessid=3221487823) [2025-04-21 14:09:08.654884] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0195-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.654984] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDDA-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.657027] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0197-0-0] [lt=78][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.657039] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDDC-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.657032] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] ====== checkpoint timer task ====== [2025-04-21 14:09:08.658069] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:08.658138] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=67] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:08.658220] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:08.658332] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=107] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:08.658366] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:08.658394] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215744209918001, v:0}) [2025-04-21 14:09:08.658415] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:08.658441] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:08.658476] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:08.658503] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:08.658553] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=0] REACH SYSLOG RATE LIMIT [bandwidth] [2025-04-21 14:09:08.658590] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=48] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:08.659618] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:08.659661] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=43] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:08.659717] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:08.659789] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=69] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:08.659807] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:08.659830] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:08.659855] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:08.659878] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:08.659905] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=1] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:08.659925] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:08.661457] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF012F-0-0] [lt=19][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.665300] WDIAG get_refactored (ob_hashtable.h:1120) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8D-0-0] [lt=28][errcode=-4201] hashtable not init [2025-04-21 14:09:08.665347] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620066][T1_L0_G0][T1][YB420B1D7AB6-00063343B5CEFD8D-0-0] [lt=45] get cursor info failed(cursor_id=43, get_sessid()=3221487630) [2025-04-21 14:09:08.665509] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=3] get number(ret=0, service_type_=0, range=1, base_id=1745215748664637000, start_id=1745215748664637000, end_id=1745215748664637001) [2025-04-21 14:09:08.669469] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.673459] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0198-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.675550] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F019A-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.691612] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=63] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:08.691730] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:08.691887] WDIAG read_multi_row (ob_table_access_helper.h:238) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:08.693467] INFO delete_row (ob_table_access_helper.h:312) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215748691916) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215748691916) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:08.693601] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:08.694805] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.694923] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.694963] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.695313] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.695585] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.695653] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.695661] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.695969] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.696019] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.696137] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.696383] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=54] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:08.697796] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=59] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:08.697855] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=76] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}) [2025-04-21 14:09:08.715997] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=41] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215748715985], gts:1745215748715893000, latest_srr:[mts=1745215748715985]}) [2025-04-21 14:09:08.740681] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:08.741955] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=66] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:08.742056] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215738772378000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:08.763373] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA3-0-0] [lt=78] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:08.764668] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=73] PNIO [ratelimit] time: 1745215748764663, bytes: 4892277, bw: 0.017986 MB/s, add_ts: 1007616, add_bytes: 19003 [2025-04-21 14:09:08.769564] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.785607] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215748785598000, start_id=1745215748785598000, end_id=1745215748785598001) [2025-04-21 14:09:08.791664] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:08.794378] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:08.811438] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:08.811485] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] try gc retain ctx [2025-04-21 14:09:08.811500] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:08.811540] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215748215041004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215738703981000, v:0}, keep_alive_scn_:{val:1745215743709736000, v:0}, update_ts_:1745215748811204}) [2025-04-21 14:09:08.812206] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:08.812510] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:08.812681] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=95] finish update min start scn(max_decided_scn={val:1745215748215041004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215738703981000, v:0}, keep_alive_scn_:{val:1745215743709736000, v:0}, update_ts_:1745215748812269}) [2025-04-21 14:09:08.813195] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] [CACHE] tenant_id= 1 cache memory info: [CACHE] tenant_id= 1 | cache_name= schema_cache | cache_size= 27048960 | cache_store_size= 24969216 | cache_map_size= 2079744 | kv_cnt= 1505 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= vtable_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 38 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 2205 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 6 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= log_kv_cache | cache_size= 70745088 | cache_store_size= 68665344 | cache_map_size= 2079744 | kv_cnt= 1003 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 171 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 52 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:08.813288] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] [CACHE] tenant_id= 1001 cache memory info: [CACHE] tenant_id= 1001 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 85 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 85 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 1917 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= log_kv_cache | cache_size= 29129728 | cache_store_size= 27049984 | cache_map_size= 2079744 | kv_cnt= 399 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 83 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:08.813369] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=20] [CACHE] tenant_id= 1002 cache memory info: [CACHE] tenant_id= 1002 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 85 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 86 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= storage_meta_cache | cache_size= 16645120 | cache_store_size= 14565376 | cache_map_size= 2079744 | kv_cnt= 4318 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= log_kv_cache | cache_size= 29129728 | cache_store_size= 27049984 | cache_map_size= 2079744 | kv_cnt= 397 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 107 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 7 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:08.813411] INFO print_current_status (ob_kvcache_hazard_version.cpp:328) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=25] [KVCACHE-HAZARD] hazard version status info: current_version: 5045 | min_version= 5045 | total_nodes_count: 21 | [KVCACHE-HAZARD] i= 111 | acquire_version=18446744073709551615 | waiting_nodes_count= 18 | last_retire_version= 5024 | [KVCACHE-HAZARD] i= 455 | acquire_version=18446744073709551615 | waiting_nodes_count= 2 | last_retire_version= 4930 | [KVCACHE-HAZARD] i= 463 | acquire_version=18446744073709551615 | waiting_nodes_count= 1 | last_retire_version= 3936 | [2025-04-21 14:09:08.813687] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215745712724000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:08.826167] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=51] gc stale ls task succ [2025-04-21 14:09:08.833586] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:08.833637] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:08.833654] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:08.833676] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:08.833700] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254953383825, flush_io_finished_ret_:0, flush_io_finished_round_:140, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:08.834516] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:08.839043] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F019C-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.840323] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1745215748840319, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2025-04-21 14:09:08.840929] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F019E-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.841616] INFO [STORAGE] runTimerTask (ob_ddl_heart_beat_task.cpp:49) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=21] send to rs all task status succeed [2025-04-21 14:09:08.848457] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=41] ObArchiveSender is running(thread_index=1) [2025-04-21 14:09:08.863241] WDIAG [SHARE] refresh (ob_task_define.cpp:402) [619494][LogLimiterRefre][T0][Y0-0000000000000000-0-0] [lt=93][errcode=0] Throttled WDIAG logs in last second(details {error code, dropped logs, earliest tid}=[{errcode:0, dropped:8926, tid:620051}]) [2025-04-21 14:09:08.869654] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.875894] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A1-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.876590] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A2-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:08.882585] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:08.882637] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.888883] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4065, offset=75978}, end_cursor:ObLogCursor{file_id=3, log_id=4066, offset=76284}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77550050, len:1846, log_data_len:306, seq:4065, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:08.889309] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE69-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:08.889371] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE69-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215748215041004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215748215041004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:08.892652] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE69-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:08.894962] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=62] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4066, offset=76284}, end_cursor:ObLogCursor{file_id=3, log_id=4067, offset=76581}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77554050, len:1540, log_data_len:297, seq:4066, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:08.895276] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE69-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:08.895331] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE69-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215748715893000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215748715893000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:08.907054] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5B-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:08.907130] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5B-0-0] [lt=73] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:08.912979] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=16] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:08.913060] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=79] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1649, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:08.913078] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:08.913101] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=22] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-523, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:08.913122] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=20] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1182, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:08.924999] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=34] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:08.925801] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:08.927955] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=59] get number(ret=0, service_type_=0, range=1, base_id=1745215748927515000, start_id=1745215748927515000, end_id=1745215748927515001) [2025-04-21 14:09:08.958920] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=59] current monitor number(seq_=-1) [2025-04-21 14:09:08.960239] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:08.960290] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:08.969729] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:08.987791] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215748785598000, v:0}, new_max_version={val:1745215748785598000, v:0}, last_min_version={val:1745215748585280002, v:0}, last_max_version={val:1745215748585280002, v:0}, total_time_us=3763, delta_us=202189) [2025-04-21 14:09:08.987758] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=20] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215748215041004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=772702, in_cluster_service=true, cluster_version={val:1745215748215041003, v:0}, min_cluster_version={val:1745215748215041003, v:0}, max_cluster_version={val:1745215748215041003, v:0}, get_cluster_version_err=0, cluster_version_delta=772702, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1256, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=79863479, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:08.987847] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215748785598000, v:0}, min_version={val:1745215748785598000, v:0}, max_version={val:1745215748785598000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:08.999551] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6800000, replace_num=100000) [2025-04-21 14:09:08.999605] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:09.003049] INFO [STORAGE.BLKMGR] mark_macro_blocks (ob_block_manager.cpp:1066) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=81] no block alloc/free, no need to mark blocks(ret=0, mark_info.count()=0) [2025-04-21 14:09:09.003096] INFO [STORAGE.BLKMGR] mark_and_sweep (ob_block_manager.cpp:1046) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] finish once mark and sweep(ret=0, alloc_num=9, mark_info.count()=0, marker_status={total_block_count:66560, reserved_block_count:2, linked_block_count:0, tmp_file_count:0, data_block_count:0, shared_data_block_count:12, index_block_count:0, ids_block_count:0, disk_block_count:0, bloomfiter_count:0, hold_count:46, pending_free_count:4, free_count:66512, shared_meta_block_count:34, mark_cost_time:60, sweep_cost_time:0, start_time:"2025-04-21 14:09:09.3031", last_end_time:"2025-04-21 14:07:39.1988", hold_info:nothing, mark_finished:false}, map_cnt=46) [2025-04-21 14:09:09.013313] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=27] [APPLY STAT CB APPEND COST TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=30, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:09.013356] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=42] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=2798, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:09.013371] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=13] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:09.013393] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=20] [APPLY STAT CB EXECUTE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-492, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:09.013412] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F017B-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=2335, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:09.013943] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:09.022221] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:09.022266] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC1-0-0] [lt=36] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:09.022278] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=56] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:09.022313] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC1-0-0] [lt=43] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:09.038031] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=64] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:09.044940] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:09.044994] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=52] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:09.045593] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=32] update_check_range(min_check_version=13, max_check_version=14, global_version=15) [2025-04-21 14:09:09.069212] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 239 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 88 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 21 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 94 245 0 1002 2 32 1 0 1002 4 1 1 0 1002 5 20 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 23650 [2025-04-21 14:09:09.069282] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=44] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,076,969,472 rpc_hold: 0 cache_hold: 132,120,576 cache_used: 132,120,576 cache_item_count: 63 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:09.069598] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,451,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,792,320 used= 4,210,688 count= 71 avg_used= 59,305 block_cnt= 71 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,218,112 used= 3,084,912 count= 666 avg_used= 4,632 block_cnt= 666 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,603,840 used= 1,517,936 count= 42 avg_used= 36,141 block_cnt= 42 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 6 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 609,600 used= 595,200 count= 75 avg_used= 7,936 block_cnt= 75 chunk_cnt= 14 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 383,616 used= 368,064 count= 81 avg_used= 4,544 block_cnt= 81 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 227,584 used= 222,208 count= 28 avg_used= 7,936 block_cnt= 28 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 10,112 used= 7,395 count= 14 avg_used= 528 block_cnt= 13 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,768 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,451,072 used= 376,298,039 count= 32,202 avg_used= 11,685 mod=SUMMARY [2025-04-21 14:09:09.069649] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:09:09.069676] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:09:09.069700] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=12] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 88,452,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 83,453,440 used= 75,789,527 count= 3,772 avg_used= 20,092 block_cnt= 3,772 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,550,144 used= 3,337,968 count= 367 avg_used= 9,095 block_cnt= 367 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,447,040 used= 1,319,360 count= 665 avg_used= 1,984 block_cnt= 222 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 88,452,608 used= 80,448,455 count= 4,806 avg_used= 16,739 mod=SUMMARY [2025-04-21 14:09:09.069735] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:09:09.069761] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:09:09.069800] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 132,120,576 used= 132,120,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 132,120,576 used= 0 count= 63 avg_used= 0 mod=SUMMARY [2025-04-21 14:09:09.069828] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:09:09.069854] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:09.069818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.069880] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:09.069908] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:09:09.069946] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,723,904 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,853,184 used= 1,809,408 count= 228 avg_used= 7,936 block_cnt= 228 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,723,904 used= 19,651,136 count= 232 avg_used= 84,703 mod=SUMMARY [2025-04-21 14:09:09.069977] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:09:09.070015] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:09:09.070050] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:09.070344] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,488,976 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:09.084916] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.169899] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.185904] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=106] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4099) [2025-04-21 14:09:09.199721] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:09.214590] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=103] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:09.216444] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=51] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215749216415], gts:1745215749216256000, latest_srr:[mts=1745215749216415]}) [2025-04-21 14:09:09.216499] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:09.216711] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=412, get_gts_with_stc_cnt=2, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=2, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:09.237202] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=31] [APPLY STAT CB APPEND COST TIME](cur_stat_count=76, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:09.237275] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=72] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=76, stat_interval=5000000, avg (count/cost)=2119, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:09.237292] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=76, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:09.237307] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=76, stat_interval=5000000, avg (count/cost)=-454, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:09.237320] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=76, stat_interval=5000000, avg (count/cost)=1727, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:09.248427] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1001, min_version={val:1745215749050187000, v:0}, base_version={val:1745215748849481000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215749050187000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215749248386, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:09.248739] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0134-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.250986] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF000C-0-0] [lt=86] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=400, Holding Memory(MB)=68, Tenant Remain Memory(MB)=554, Usable Remain Memory(MB)=332, Last Update Limit Timestamp=1745215749250603, Is Updated=true) [2025-04-21 14:09:09.251279] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0134-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254954801585, cache_obj->added_lc()=false, cache_obj->get_object_id()=712, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:09.252454] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC9-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:09.252506] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDC9-0-0] [lt=44] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=54) [2025-04-21 14:09:09.253280] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] get_max_applied_scn(scn={val:1745215749089853000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26249377}, palf_committed_end_scn_:{val:1745215749250603000, v:0}, last_check_scn_:{val:1745215749250603000, v:0}, max_applied_cb_scn_:{val:1745215749089853000, v:0}}) [2025-04-21 14:09:09.253357] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26249377}, readable_log_tail:{lsn:26249377}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40855391, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:09.269988] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.278833] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE06-0-0] [lt=30] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:09.278895] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE06-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:09.290496] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=94] get number(ret=0, service_type_=0, range=1, base_id=1745215749290186000, start_id=1745215749290186000, end_id=1745215749290186001) [2025-04-21 14:09:09.292875] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=65] get_max_applied_scn(scn={val:1745215748715893003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17370165}, palf_committed_end_scn_:{val:1745215748715893004, v:0}, last_check_scn_:{val:1745215748715893004, v:0}, max_applied_cb_scn_:{val:1745215748715893003, v:0}}) [2025-04-21 14:09:09.292956] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=69] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17370165}, readable_log_tail:{lsn:17370165}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49734603, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:09.293758] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=76] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:09.327442] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE60-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:09.327516] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE60-0-0] [lt=72] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:09.329403] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4221) [2025-04-21 14:09:09.329480] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=157, avg_log_gen_to_submit_time=178, avg_log_submit_to_flush_time=1525, avg_log_submit_to_slide_time=1550) [2025-04-21 14:09:09.350781] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:09.350856] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:09.351045] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:09.351230] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:09.351314] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:18, schedule:44, submit:11, rt:1304, total:1377) [2025-04-21 14:09:09.351390] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:09.351456] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:18, schedule:44, submit:11, device:1304, total:1377) [2025-04-21 14:09:09.351521] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:09.351594] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1053, total:1076) [2025-04-21 14:09:09.351672] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:09.351718] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1053, total:1076) [2025-04-21 14:09:09.351779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:09.351806] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:09.354601] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=108] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:09.370069] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.382783] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:09.382874] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=83] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.388113] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=179] get_max_applied_scn(scn={val:1745215748715893004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8787593}, palf_committed_end_scn_:{val:1745215749216256000, v:0}, last_check_scn_:{val:1745215749216256000, v:0}, max_applied_cb_scn_:{val:1745215748715893004, v:0}}) [2025-04-21 14:09:09.388194] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=75] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8787593}, readable_log_tail:{lsn:8787593}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58317175, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:09.390614] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620159][T1001_ObXAHbWor][T1001][Y0-0000000000000000-0-0] [lt=47] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:09.399874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:09.400442] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:09.400501] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=41] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:09.400535] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=30] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=29) [2025-04-21 14:09:09.400993] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:09.401142] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA2-0-0] [lt=55] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215749290186000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:09.401279] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA2-0-0] [lt=131] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:09.411981] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:09.412059] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:09.412112] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:09.412159] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:09.412193] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:09.413703] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1538, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:09.413752] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:09.413794] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:09.413836] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1679, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:09.413868] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:09.414361] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1518, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:09.414398] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=118, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:09.414444] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:09.414473] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1692, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:09.414498] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:09.415342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=106] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:09.421777] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:09.434659] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:09.435086] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:09.435141] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:09.435167] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:09.435194] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:09.435218] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254953985322, flush_io_finished_ret_:0, flush_io_finished_round_:141, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:09.435626] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:09.441528] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:09.442520] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=61] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:09.442590] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=67] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:09.442671] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:09.442800] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=123] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:09.442849] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:09.442878] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215741282879001, v:0}) [2025-04-21 14:09:09.442898] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:09.442918] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:09.442942] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:09.442976] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:09.443000] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:09.443033] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:09.443068] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:09.443091] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:09.451961] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1514, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:09.452027] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:09.452072] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:09.452133] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG LIFE TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=1661, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:09.452160] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=19, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:09.460441] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:09.460518] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.470142] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=81][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.474822] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.474928] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=59] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.476040] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.476105] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.490034] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=106] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=19, avg_log_batch_cnt=1, total_group_log_size=10138, avg_group_log_size=533) [2025-04-21 14:09:09.490089] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=10138) [2025-04-21 14:09:09.492042] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=10138) [2025-04-21 14:09:09.492134] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10138) [2025-04-21 14:09:09.492221] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=19, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1608, avg_log_submit_to_slide_time=1629) [2025-04-21 14:09:09.492288] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10138, hit_cnt=19, read_cnt=19, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:09.498138] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=66] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:09.513922] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:09.514014] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:09.514079] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1633, avg_log_submit_to_slide_time=1650) [2025-04-21 14:09:09.514130] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:09.514158] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1625, avg_log_submit_to_slide_time=1643) [2025-04-21 14:09:09.514201] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:09.514239] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:09.528162] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:09.528224] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4100, avg_group_log_size=372) [2025-04-21 14:09:09.528253] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:09.528287] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=47] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:09.529484] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1354, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:09.529544] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4100) [2025-04-21 14:09:09.529580] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:09.529626] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:09.529665] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1656, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:09.529690] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:09.529749] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4100, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:09.570228] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.580834] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:09:09.585058] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:09.585112] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.585995] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:09.586048] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:09.586074] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:09.586100] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:09.586124] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254954136220, flush_io_finished_ret_:0, flush_io_finished_round_:141, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:09.597912] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:09.600032] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:09.601060] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:09.601168] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:09:09.605071] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:09.605114] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:09.606859] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:09.606897] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:09.610052] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=73][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:09.612461] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:09.612565] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=71] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:09.612606] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:09.614090] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:09.615889] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:09.625196] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=2200000, clean_num=200000) [2025-04-21 14:09:09.635746] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=43] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:09.635816] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=66] try gc retain ctx [2025-04-21 14:09:09.635840] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=23] try to retry start_working [2025-04-21 14:09:09.635919] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215749489253000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215739477030001, v:0}, keep_alive_scn_:{val:1745215744485233001, v:0}, update_ts_:1745215749634467}) [2025-04-21 14:09:09.637513] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=54] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215757945792000, latest_log_ts:{val:1745215741282879001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:09.639553] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCC-0-0] [lt=40] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:09.640088] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=69] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1001, is_allowed_broadcast=true) [2025-04-21 14:09:09.649994] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF000E-0-0] [lt=156] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012129878997802734e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817524869643546026e+02) [2025-04-21 14:09:09.653568] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=30] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:09.653631] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=46] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=27) [2025-04-21 14:09:09.654882] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:09.654950] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=51] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:09.654981] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=27] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:09.655004] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=22] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=27) [2025-04-21 14:09:09.658505] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDDD-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.658523] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A4-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.660664] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A6-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.661982] WDIAG begin (ob_hashtable.h:954) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8B-0-0] [lt=11][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.664366] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8B-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254955214672, cache_obj->added_lc()=false, cache_obj->get_object_id()=713, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:09.664760] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A7-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.670312] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=87][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.676728] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01A8-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.679070] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01AA-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.689487] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=27] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:09.689543] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=38] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=29) [2025-04-21 14:09:09.692977] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=35] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:09.693040] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=53] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:09.693071] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=27] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=29) [2025-04-21 14:09:09.695377] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695437] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695474] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695665] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695737] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695795] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695851] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695887] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.695894] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.696213] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.696459] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:09.716997] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=30] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=414, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:09.721957] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDF9-0-0] [lt=32] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:09.753397] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDF7-0-0] [lt=40] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:09.770466] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:09.770502] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=34] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:09.770527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.772302] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1745215749772297, bytes: 4906500, bw: 0.013461 MB/s, add_ts: 1007634, add_bytes: 14223 [2025-04-21 14:09:09.791783] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:09.800169] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:09.814934] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:09.814984] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:09.825688] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:09.826240] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:09:09.834676] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:09.842184] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01AC-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.844211] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01AE-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.847952] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215749847948, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2025-04-21 14:09:09.852232] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:09.859803] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:09:09.869518] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=23] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65849296}, readable_log_tail:{lsn:65849296}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1255472, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:09.869648] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=128] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:09:09.869693] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:09.869898] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFE08-0-0] [lt=53][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:09:09.870506] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.880127] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B1-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.880132] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=15, gc_interval=10000000) [2025-04-21 14:09:09.880201] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=35] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:09.880236] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=24] gc_check_member_list_ cost time(ret=0, time_us=67) [2025-04-21 14:09:09.880268] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=25] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:09.880294] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:09.880321] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=22] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:09.880345] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=26) [2025-04-21 14:09:09.880359] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2025-04-21 14:09:09.880800] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B2-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:09.882973] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:09.883042] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.895352] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=51] finish to resize log external storage handler(current_ts=1745215749895346, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:09.900854] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=46] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4067, offset=76581}, end_cursor:ObLogCursor{file_id=3, log_id=4068, offset=76887}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77558050, len:1243, log_data_len:306, seq:4067, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:09.901205] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6A-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:09.901276] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6A-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215749716329000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215749716329000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:09.904743] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6A-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:09.908542] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE0-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:09.908525] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5D-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:09.908581] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5D-0-0] [lt=53] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:09.908649] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=67] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4068, offset=76887}, end_cursor:ObLogCursor{file_id=3, log_id=4069, offset=77184}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7755c050, len:937, log_data_len:297, seq:4068, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:09.908906] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6A-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:09.908959] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6A-0-0] [lt=31] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215749716329000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215749716329000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:09.914209] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:09.914257] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:09.914278] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:09.914304] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:09.914793] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=43] ls blacklist refresh finish(cost_time=8967) [2025-04-21 14:09:09.917407] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=70] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:09.917590] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:09.918299] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=705] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:09.945688] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDFB-0-0] [lt=41] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:09.945776] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDFD-0-0] [lt=41] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:09.959077] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=48] current monitor number(seq_=-1) [2025-04-21 14:09:09.960632] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:09.960679] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:09.970590] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:09.977127] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=47] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14744, max_lsn:65849418, max_scn:{val:1745215749786648001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65849418}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65849296}, last_submit_end_lsn:{lsn:65849418}, last_submit_log_id:14744, last_submit_log_pid:3, max_flushed_lsn:{lsn:65849296}, max_flushed_end_lsn:{lsn:65849418}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65849418}, last_slide_log_id:14744, last_slide_scn:{val:1745215749786648001, v:0}, last_slide_lsn:{lsn:65849296}, last_slide_end_lsn:{lsn:65849418}, last_slide_log_pid:3, last_slide_log_accum_checksum:3058739552, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14745, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65849418}, readable_log_tail:{lsn:65849418}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1255350, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:09:09.977382] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=248] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215749929730, last_flushed_end_lsn:{lsn:65849418}}]) [2025-04-21 14:09:09.977408] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14745, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215749929730, last_flushed_end_lsn:{lsn:65849418}}]) [2025-04-21 14:09:09.988746] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215749786648000, v:0}, new_max_version={val:1745215749786648000, v:0}, last_min_version={val:1745215749585747000, v:0}, last_max_version={val:1745215749585747000, v:0}, total_time_us=3935, delta_us=202094) [2025-04-21 14:09:09.988810] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=61] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215749786648000, v:0}, min_version={val:1745215749786648000, v:0}, max_version={val:1745215749786648000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:09.993088] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=49] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:10.000320] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:10.026210] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:10.027698] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8D-0-0] [lt=13] MediumCheckTask(cost_ts=15) [2025-04-21 14:09:10.036850] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:10.038156] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:10.056251] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=17] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:10.056373] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=77] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:10.056408] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=233, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:10.056485] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:10.056570] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:10.056602] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=27, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:10.070680] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.077193] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=344) [2025-04-21 14:09:10.085251] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:10.085319] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.102992] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=56] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:10.112510] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=39] BlockGCTimerTask success(ret=0, cost_time_us=14, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:10.170765] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=98][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.186873] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:10.200463] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:10.217518] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=63] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:10.226876] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:10.249081] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215750050078000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198989, in_cluster_service=true, cluster_version={val:1745215749850308000, v:0}, min_cluster_version={val:1745215749850308000, v:0}, max_cluster_version={val:1745215749850308000, v:0}, get_cluster_version_err=0, cluster_version_delta=398759, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1267, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=85069660, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:10.255298] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0136-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.257699] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0136-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254955808007, cache_obj->added_lc()=false, cache_obj->get_object_id()=714, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:10.270844] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.281163] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE07-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:10.281224] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE07-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:10.329315] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE61-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:10.329378] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE61-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:10.330049] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:10.330105] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1823, avg_log_submit_to_slide_time=1846) [2025-04-21 14:09:10.352834] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:10.352916] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:10.353103] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:10.353303] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:10.353390] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:16, schedule:30, submit:7, rt:1645, total:1699) [2025-04-21 14:09:10.353470] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:10.353538] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:16, schedule:30, submit:7, device:1645, total:1699) [2025-04-21 14:09:10.353601] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:10.353676] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:590, total:609) [2025-04-21 14:09:10.353757] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:10.353804] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:590, total:609) [2025-04-21 14:09:10.353866] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:10.353893] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:10.370928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.383164] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:10.383222] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.383676] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:10.385055] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=54] no need to update min/max version(new_version={val:1745215749985854000, v:0}, min_version={val:1745215749985854000, v:0}, max_version={val:1745215749985854000, v:0}) [2025-04-21 14:09:10.385521] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215750384633000, start_id=1745215750384633000, end_id=1745215750384633001) [2025-04-21 14:09:10.393764] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:10.395066] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=47] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:10.395170] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215741191562000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:10.400611] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:10.405226] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:10.405272] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:10.413039] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:10.413110] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:10.413147] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:10.413184] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:10.413215] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:10.414443] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1498, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:10.414503] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:10.414519] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1562, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:10.414573] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:10.414564] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:10.414601] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1626, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:10.414634] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:10.414679] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:10.414717] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1706, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:10.414746] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:10.421582] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:10.421856] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=54] gc stale ls task succ [2025-04-21 14:09:10.427384] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:10.434857] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=59] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:10.435356] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:10.435410] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:10.435429] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:10.435454] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:10.435477] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254954985581, flush_io_finished_ret_:0, flush_io_finished_round_:142, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:10.436449] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=155] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:10.452817] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1457, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:10.452871] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:10.452935] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:10.452981] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1607, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:10.453030] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:10.460800] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:10.460849] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.471013] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.475286] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.475634] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.476135] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.476196] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.490801] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8375, avg_group_log_size=492) [2025-04-21 14:09:10.490853] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8375) [2025-04-21 14:09:10.492644] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8375) [2025-04-21 14:09:10.492767] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8375) [2025-04-21 14:09:10.492835] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1550, avg_log_submit_to_slide_time=1574) [2025-04-21 14:09:10.492900] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8375, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:10.514949] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:10.515041] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1663, avg_log_submit_to_slide_time=1685) [2025-04-21 14:09:10.515094] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:10.515886] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:10.515956] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:10.515997] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1713, avg_log_submit_to_slide_time=1730) [2025-04-21 14:09:10.516041] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:10.528987] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:10.529084] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=80] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3495, avg_group_log_size=349) [2025-04-21 14:09:10.529117] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:10.530619] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1732, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:10.530716] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=93] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3495) [2025-04-21 14:09:10.530765] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:10.530848] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:10.530887] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1889, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:10.530913] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:10.530970] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3495, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:10.570700] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:10.570765] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=56] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:10.571086] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.580907] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:10.585450] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:10.585503] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.586247] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:10.586299] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:10.586318] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:10.586345] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:10.586370] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254955136482, flush_io_finished_ret_:0, flush_io_finished_round_:142, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:10.598087] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:10.600743] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:10.605433] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:10.605476] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:10.607150] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:10.607187] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:10.613226] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:10.613314] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:10.613349] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:10.614803] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:10.615875] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:09:10.615916] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=31] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:10.615962] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:10.624897] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:10.626122] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:10.626219] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215745589109000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:10.627868] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:10.651103] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0013-0-0] [lt=81] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:10.661928] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B4-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.663931] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B6-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.665938] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B7-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.667849] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01B9-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.671155] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.682730] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01BA-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.684428] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01BC-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.695225] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695295] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695450] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695505] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695517] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695541] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695898] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.695964] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.696007] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.696304] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.696532] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:10.699730] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=81] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:10.702434] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=48] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:10.718330] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=66] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215750718311], gts:1745215750717747000, latest_srr:[mts=1745215750718311]}) [2025-04-21 14:09:10.720716] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=26] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:10.720765] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=46] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:09:10.720791] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=25] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:10.720818] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=23] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:10.764252] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:10.771222] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.779895] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1745215750779891, bytes: 4919272, bw: 0.012089 MB/s, add_ts: 1007594, add_bytes: 12772 [2025-04-21 14:09:10.781482] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=45] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:10.791898] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=44] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:10.800883] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:10.814795] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17376091, this={dio_aligned_buf:{buf_write_offset:981, buf_padding_size:3115, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3012, truncate_used_ts:1155}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17375232, buf_len=122, total_write_size=13840, total_write_size_after_dio=430080, ob_pwrite_used_ts=186029, count=101, each_pwrite_cost=1841) [2025-04-21 14:09:10.826314] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:09:10.828416] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:10.833882] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:10.833933] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:10.833952] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:10.833982] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:10.834006] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254955384124, flush_io_finished_ret_:0, flush_io_finished_round_:142, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:10.834848] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:10.845422] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01BE-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.847361] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C0-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.855555] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1745215750855551, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007603, add_bytes: 0 [2025-04-21 14:09:10.871311] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.883326] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:10.883381] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.884647] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C3-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.885285] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C4-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:10.910052] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5E-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:10.910124] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5E-0-0] [lt=70] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:10.915033] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4069, offset=77184}, end_cursor:ObLogCursor{file_id=3, log_id=4070, offset=77490}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77560050, len:640, log_data_len:306, seq:4069, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:10.915357] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6B-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:10.915430] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6B-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215750717747000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215750717747000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:10.919144] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6B-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:10.922089] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=68] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4070, offset=77490}, end_cursor:ObLogCursor{file_id=3, log_id=4071, offset=77787}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77564050, len:4430, log_data_len:297, seq:4070, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:10.922400] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6B-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:10.922459] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6B-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215750717747000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215750717747000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:10.960958] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:10.961028] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:10.967550] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=42] LogLoopThread round_cost_time(us)(round_cost_time=35) [2025-04-21 14:09:10.971379] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:10.989316] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215750786331000, v:0}, new_max_version={val:1745215750786331000, v:0}, last_min_version={val:1745215750586912000, v:0}, last_max_version={val:1745215750586912000, v:0}, total_time_us=3771, delta_us=202981) [2025-04-21 14:09:10.989373] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215750786331000, v:0}, min_version={val:1745215750786331000, v:0}, max_version={val:1745215750786331000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:11.001031] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:11.023060] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=36] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:11.023091] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC2-0-0] [lt=19] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:11.023107] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=45] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:11.023140] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC2-0-0] [lt=45] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:11.028879] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=40] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:11.028939] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:11.029052] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=60] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:11.033000] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=55] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:11.038320] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=61] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:11.039624] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=28] === Run print tenant memory usage task === [2025-04-21 14:09:11.039722] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=43] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 136,200,192 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,751,039,394 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,076,969,472 max_mem_memstore_can_get_now= 2,458,828,800 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,751,039,394 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 71,934,340 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 549,433,344 max_mem_memstore_can_get_now= 359,671,766 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,751,039,394 active_memstore_used= 67,108,864 total_memstore_used= 67,108,864 total_memstore_hold= 67,108,864 memstore_freeze_trigger_limit= 62,525,420 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 649,814,016 max_mem_memstore_can_get_now= 312,627,164 memstore_alloc_pos= 67,108,864 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:11.039847] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=34] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,195,035,648 total_hold= 3,365,928,960 used= 3,119,333,376 freelists_hold= 75,702,272 total_maps= 1,210 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,881,549,824 divisive_memory_used= 136,200,192 virtual_memory_used= 4,571,480,064 [CHUNK_MGR] 2 MB_CACHE: hold= 27,262,976 free= 13 pushes= 326,464 pops= 326,451 maps= 1,076 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 139 pops= 137 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:11.039906] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=30] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 31042, delta_count= 11, avg_cost_time= 2822 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:11.053293] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:11.062807] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD93-0-0] [lt=41] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:11.063651] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] [COMPACTION DAG STATUS] (start_time=1745215741061402, end_time=1745215751063648, dag_status={}) [2025-04-21 14:09:11.063691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063738] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063763] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063775] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:11.063812] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=11] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063831] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063845] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063859] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063872] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063886] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063899] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063912] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063939] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063953] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063966] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063979] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.063993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064007] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064060] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064076] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064091] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064119] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064133] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064147] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064181] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064201] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064240] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064260] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064280] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064300] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064319] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064338] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064371] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064409] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064429] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064448] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064488] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064508] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064527] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064565] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064584] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064622] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064642] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064681] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064701] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064720] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064739] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064777] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064797] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064815] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064872] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064892] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064912] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064970] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.064989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.065026] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.065042] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:11.065074] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=29] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:11.065094] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:11.065114] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:11.065125] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:11.065143] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:11.065159] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:11.065177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:11.065193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:11.065211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:11.065229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:11.065248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:11.071454] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.085609] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:11.085663] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.127297] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] success to update min reserved snapshot(reserved_snapshot=1745213941191562000, duration=1800, snapshot_gc_ts=1745215741191562000) [2025-04-21 14:09:11.128812] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=21] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:11.128863] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=45] start lib cache evict(tenant_id=1002, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:11.128891] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=26] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=41943040, mem_limit=53687090, cache_obj_num=146, cache_node_num=146) [2025-04-21 14:09:11.128915] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:11.130308] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=8793885, this={dio_aligned_buf:{buf_write_offset:3981, buf_padding_size:115, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3497, truncate_used_ts:1440}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=8790016, buf_len=112, total_write_size=13293, total_write_size_after_dio=417792, ob_pwrite_used_ts=178294, count=99, each_pwrite_cost=1800) [2025-04-21 14:09:11.130644] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=53] update reserved snapshot finished(cost_ts=3351, reserved_snapshot=1745213941191562000) [2025-04-21 14:09:11.132079] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=20] Dumping All Cache Objs(alloc_obj_list.count()=146, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}]) [2025-04-21 14:09:11.132414] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=332] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:11.140851] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:11.142606] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620258][T1002_ReqMemEvi][T1002][YB420B1D7AB6-00063343B00EFDA2-0-0] [lt=53] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=91) [2025-04-21 14:09:11.142862] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215751142598000, start_id=1745215751142598000, end_id=1745215751142598001) [2025-04-21 14:09:11.171541] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.179563] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=32] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:11.180871] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=42] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:11.180913] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=38] no transfer partition job [2025-04-21 14:09:11.180932] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=14] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:11.183618] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=23] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:11.183679] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=47] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:11.183723] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD93-0-0] [lt=36] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:11.187811] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3494) [2025-04-21 14:09:11.189467] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=33] [APPLY STAT CB APPEND COST TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:11.189560] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=91] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=1949, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:11.189597] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=35] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:11.189627] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=28] [APPLY STAT CB EXECUTE TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=-510, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:11.189654] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0133-0-0] [lt=26] [APPLY STAT CB TOTAL TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=1501, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:11.206016] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=6900000, replace_num=100000) [2025-04-21 14:09:11.206069] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:11.218612] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=60] ts response task statistics(alloc_count=3174, free_count=1586) [2025-04-21 14:09:11.218695] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:11.229446] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:11.253137] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCA-0-0] [lt=41] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:11.253194] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCA-0-0] [lt=48] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=59) [2025-04-21 14:09:11.261966] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0137-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.264660] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=58][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:11.265381] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0137-0-0] [lt=48][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254956815683, cache_obj->added_lc()=false, cache_obj->get_object_id()=715, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:11.271630] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.283997] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE08-0-0] [lt=37] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:11.284047] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE08-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:11.291389] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] submit log success(service_type_=0, last_id=1745215767945792000, limited_id=1745215767945792000) [2025-04-21 14:09:11.291433] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] submit log with lock success(service_type_=0, last_id=1745215767945792000, limited_id=1745215767945792000) [2025-04-21 14:09:11.293503] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215767945792000, latest_scn={val:1745215751290420001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:11.293602] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=98] handle submit callback(service_type_=0, success=true, used_ts=2215, log_ts={val:1745215751290420001, v:0}, limited_id=1745215767945792000) [2025-04-21 14:09:11.293631] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=27] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:11.293649] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:11.294903] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1745215751294717000, start_id=1745215751294717000, end_id=1745215751294717001) [2025-04-21 14:09:11.331257] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3494) [2025-04-21 14:09:11.331347] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1551, avg_log_submit_to_slide_time=1579) [2025-04-21 14:09:11.331358] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE62-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:11.331417] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE62-0-0] [lt=56] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:11.354898] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:11.354982] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:11.355168] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:11.355366] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:11.355456] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:18, schedule:49, submit:7, rt:1154, total:1229) [2025-04-21 14:09:11.355536] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:11.355620] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=74] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:18, schedule:49, submit:7, device:1154, total:1229) [2025-04-21 14:09:11.355684] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:11.355771] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:637, total:653) [2025-04-21 14:09:11.355862] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:11.355900] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:637, total:653) [2025-04-21 14:09:11.355962] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:11.355990] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:11.363054] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=71] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:11.371720] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=90][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.383510] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:11.383587] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.406179] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:11.413790] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:11.413864] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:09:11.413902] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:11.413943] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:11.413978] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:11.415339] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1516, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:11.415394] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:11.415397] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1454, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:11.415448] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:11.415456] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:11.415486] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1613, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:11.415515] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:11.415552] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:11.415571] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1589, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:11.415591] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:11.421943] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:11.430044] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:11.435036] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:11.435609] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:11.435665] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:11.435684] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:11.435712] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:11.435736] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254955985835, flush_io_finished_ret_:0, flush_io_finished_round_:143, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:11.437238] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:11.453487] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1432, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:11.453550] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:11.453598] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:11.453650] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=1688, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:11.453681] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:11.461168] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:11.461224] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.471804] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=153][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.474581] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.474825] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.474894] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.475526] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.489657] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=15] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215751201454000, v:0}, base_version={val:1745215750717747002, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215751201454000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215751489631, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:11.491372] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=18, avg_log_batch_cnt=1, total_group_log_size=8904, avg_group_log_size=494) [2025-04-21 14:09:11.491417] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8904) [2025-04-21 14:09:11.493201] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8904) [2025-04-21 14:09:11.493311] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8904) [2025-04-21 14:09:11.493387] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=107, avg_log_gen_to_submit_time=127, avg_log_submit_to_flush_time=1533, avg_log_submit_to_slide_time=1560) [2025-04-21 14:09:11.493466] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8904, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:11.515574] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2449) [2025-04-21 14:09:11.515638] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1524, avg_log_submit_to_slide_time=1544) [2025-04-21 14:09:11.515677] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:11.529768] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:11.529845] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:11.529896] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:11.531129] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1371, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:11.531227] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=95] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:11.531287] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:11.531392] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:11.531438] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1619, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:11.531488] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:11.531518] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:11.539093] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=22] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:11.539182] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=81] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:11.539202] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:11.539232] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=26] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:11.541955] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=39] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:11.543617] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=40] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:11.545101] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=39] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:11.545139] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:11.546444] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:11.546550] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:11.546580] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:11.550960] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:11.552442] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=40] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:11.552482] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:11.553816] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:11.553930] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:11.553961] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:11.558294] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=25] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:11.559783] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=40] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:11.559822] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:11.561148] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:11.561253] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:11.561282] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:11.561317] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=23] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:11.561391] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=63] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:11.561413] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=21] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:11.561446] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:11.561481] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=34] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:11.561504] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:11.561521] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:11.561548] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:11.561572] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=24] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:11.561593] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:11.561611] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:11.561638] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:11.561661] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:11.562881] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=17] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:11.562923] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=39] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:11.562945] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=21] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:11.562999] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=18] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:11.563027] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=27] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:11.563042] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=14] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:11.563067] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=21] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:11.563095] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD95-0-0] [lt=27] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:11.571874] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.580991] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:11.585801] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:11.585855] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.586506] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:11.586567] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:11.586605] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:11.586643] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:11.586679] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254956136734, flush_io_finished_ret_:0, flush_io_finished_round_:143, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:11.598263] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:11.605527] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:11.605574] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:11.606323] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:11.607295] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:11.607333] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:11.614010] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2449) [2025-04-21 14:09:11.614142] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=90] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:11.614191] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:11.615705] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2449) [2025-04-21 14:09:11.615897] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1332) [2025-04-21 14:09:11.615956] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1332) [2025-04-21 14:09:11.615992] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1491, avg_log_submit_to_slide_time=1507) [2025-04-21 14:09:11.616026] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1332, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:11.630616] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:11.639872] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=83] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=2400000, clean_num=200000) [2025-04-21 14:09:11.645559] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCD-0-0] [lt=32] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:11.651649] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0018-0-0] [lt=52] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:11.651897] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=67] get number(ret=0, service_type_=0, range=1, base_id=1745215751650914000, start_id=1745215751650914000, end_id=1745215751650914001) [2025-04-21 14:09:11.665252] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C6-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.667602] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C8-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.668937] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01C9-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.671034] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01CB-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.671951] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.685620] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01CC-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.687918] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01CE-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.694724] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.695538] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.695598] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.695615] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.695620] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.695635] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.696010] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.696098] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.696147] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=19] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.696317] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.696395] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:11.719227] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215751719096000, start_id=1745215751719096000, end_id=1745215751719096001) [2025-04-21 14:09:11.719324] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=64] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215751719312], gts:1745215751719096000, latest_srr:[mts=1745215751719312]}) [2025-04-21 14:09:11.723998] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01D0-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.727363] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215751726536000, start_id=1745215751726536000, end_id=1745215751726536001) [2025-04-21 14:09:11.730326] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01D4-0-0] [lt=65][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.747592] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:11.748813] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=58] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:11.748912] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215748781280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:11.772033] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.787528] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1745215751787523, bytes: 4933495, bw: 0.013461 MB/s, add_ts: 1007632, add_bytes: 14223 [2025-04-21 14:09:11.792012] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:11.806017] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [619992][T1_CompactionRe][T1][YB420B1D7AB6-00063343B7AEFD8A-0-0] [lt=44] InfoPoolResizeTask(cost_ts=14) [2025-04-21 14:09:11.806475] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:11.810865] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:09:11.810965] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA3-0-0] [lt=43] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:11.811093] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA3-0-0] [lt=122] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:11.815119] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:09:11.815167] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:11.825457] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=44][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:11.825597] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=45][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:11.826389] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:11.827177] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=31] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215751825628) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215751825628) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:11.835032] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:11.840427] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:11.847941] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:11.848715] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01D6-0-0] [lt=53][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.848945] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=53] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:11.849044] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=97] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:11.849130] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=50] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:11.849236] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=102] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:11.849283] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:11.849309] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215748585280001, v:0}) [2025-04-21 14:09:11.849329] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:11.849348] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:11.849371] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:11.849404] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:11.849426] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:11.849457] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:11.849492] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:11.849514] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:11.851085] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01D8-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.855705] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=85] clear dtl interm result cost(us)(clear_cost=2985, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:11.861378] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:09:11.863171] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215751863167, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2025-04-21 14:09:11.872115] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=79][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.883679] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:11.883739] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.889593] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01DA-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.890272] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01DB-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:11.911829] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5F-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:11.911905] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE5F-0-0] [lt=73] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:11.925149] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=60] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:11.928533] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4071, offset=77787}, end_cursor:ObLogCursor{file_id=3, log_id=4072, offset=78093}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77568050, len:4133, log_data_len:306, seq:4071, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:11.928968] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:11.929082] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=79] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215751726536000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215751726536000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:11.932858] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215751932012000, start_id=1745215751932012000, end_id=1745215751932012001) [2025-04-21 14:09:11.932987] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=18, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:11.935749] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=82] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4072, offset=78093}, end_cursor:ObLogCursor{file_id=3, log_id=4073, offset=78390}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7756c050, len:3827, log_data_len:297, seq:4072, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:11.936052] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=58] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:11.936114] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6C-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215751726536000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215751726536000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:11.955241] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=50] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:11.959330] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=43] current monitor number(seq_=-1) [2025-04-21 14:09:11.961366] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:11.961418] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:11.972194] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=92][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:11.990221] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=61] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215751787467000, v:0}, new_max_version={val:1745215751787467000, v:0}, last_min_version={val:1745215751586933000, v:0}, last_max_version={val:1745215751586933000, v:0}, total_time_us=3940, delta_us=202750) [2025-04-21 14:09:11.990276] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215751787467000, v:0}, min_version={val:1745215751787467000, v:0}, max_version={val:1745215751787467000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:12.006643] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:12.023780] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=41] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:12.038451] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=39] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:12.040922] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:12.045851] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=91] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:12.072268] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.085986] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:12.086048] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.094813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000) [2025-04-21 14:09:12.094871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=57] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.094949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.095933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.096978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=49] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097229] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.097995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.098986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.099986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.100962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.101978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.102924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.103998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846986}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.104994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846977}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.105935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.106939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.107999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108524] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.108983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846980}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109659] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.109989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110810] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.110934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101017}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111524] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.111980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.112969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113647] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.113976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.114973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.115959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.116948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117099] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.117960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.118952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.119991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.120985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846979}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.121983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122111] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.122974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846988}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.123957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:200005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.124976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=48] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.125955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126281] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126611] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.126949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127866] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.127999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.128980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129387] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.129977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130189] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:12.130229] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] try gc retain ctx [2025-04-21 14:09:12.130243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130250] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] try to retry start_working [2025-04-21 14:09:12.130300] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] finish update min start scn(max_decided_scn={val:1745215751987134000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215741979953001, v:0}, keep_alive_scn_:{val:1745215746983493001, v:0}, update_ts_:1745215752130008}) [2025-04-21 14:09:12.130310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.130990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131295] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:12.131384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.131968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132558] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.132950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846985}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846978}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101016}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.133953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134018] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846993}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=42] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.134985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135050] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.135979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136573] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.136962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.137969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.138963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=51] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101015}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.139983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.140964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141317] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.141978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.142961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.143937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846987}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.144983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.145981] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.146975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.147982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148697] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148831] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.148960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846981}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.149962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150424] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150620] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215752051864000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215752150557}, version_delta=98754) [2025-04-21 14:09:12.150688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.150957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.151938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152583] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.152973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846996}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.153980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846991}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.154972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.155959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846982}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.156943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846984}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.157944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158810] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.158944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846989}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.159982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846992}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160634] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.160980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213945589109000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213935579281000, max_merged_snapshot=1) [2025-04-21 14:09:12.161791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=20] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:09:12.165092] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8A-0-0] [lt=2] SSTableGCTask(cost_ts=70609) [2025-04-21 14:09:12.172356] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=83][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.186413] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215751987134000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199268, in_cluster_service=true, cluster_version={val:1745215751787467000, v:0}, min_cluster_version={val:1745215751787467000, v:0}, max_cluster_version={val:1745215751787467000, v:0}, get_cluster_version_err=0, cluster_version_delta=398935, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1319, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=89716539, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:12.188324] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3526) [2025-04-21 14:09:12.206807] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:12.208309] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=57][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:12.219834] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=51] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=422, get_gts_with_stc_cnt=26, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=26, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:12.219892] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=56] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215752219801], gts:1745215752219601000, latest_srr:[mts=1745215752219801]}) [2025-04-21 14:09:12.219930] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=35] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:12.241371] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:12.254090] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:12.268687] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0139-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.271102] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0139-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254957821410, cache_obj->added_lc()=false, cache_obj->get_object_id()=716, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:12.272431] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=96][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.285843] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE09-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:12.285911] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE09-0-0] [lt=55] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:12.331775] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:09:12.331853] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1647, avg_log_submit_to_slide_time=1673) [2025-04-21 14:09:12.333190] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE64-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:12.333255] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE64-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:12.357043] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:12.357108] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:12.357291] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:12.357473] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:12.357560] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:18, schedule:30, submit:7, rt:1272, total:1328) [2025-04-21 14:09:12.357636] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:12.357699] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:18, schedule:30, submit:7, device:1272, total:1328) [2025-04-21 14:09:12.357767] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:12.357853] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:817, total:834) [2025-04-21 14:09:12.357933] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:12.357971] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:817, total:834) [2025-04-21 14:09:12.358033] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:12.358059] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:12.372525] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.383855] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:172) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:09:12.383923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=64] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:12.383951] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.405403] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2025-04-21 14:09:12.405465] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=53] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:12.406955] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:12.414637] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:12.414725] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:12.414765] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:12.414803] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:12.414836] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:12.416247] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1551, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:12.416304] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:12.416352] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:12.416404] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1680, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:12.416435] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:12.416841] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1594, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:12.416897] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:12.416925] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:12.416948] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1762, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:12.416973] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:12.422030] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:12.423134] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:09:12.435246] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=66] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:12.435874] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:12.435934] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=50] temporary file module use no blocks [2025-04-21 14:09:12.435954] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:12.435984] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:12.436014] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254956986099, flush_io_finished_ret_:0, flush_io_finished_round_:144, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:12.438101] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:12.441854] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:12.454251] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1564, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:12.454302] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:12.454348] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:12.454376] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1726, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:12.454404] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:12.461581] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:12.461640] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.472600] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.475234] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=55] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.475613] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.475945] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.476040] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.492037] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8263, avg_group_log_size=516) [2025-04-21 14:09:12.492083] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8263) [2025-04-21 14:09:12.493797] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8263) [2025-04-21 14:09:12.493875] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8263) [2025-04-21 14:09:12.493921] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1675, avg_log_submit_to_slide_time=1693) [2025-04-21 14:09:12.493979] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8263, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:12.516274] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:12.516345] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1687, avg_log_submit_to_slide_time=1712) [2025-04-21 14:09:12.516421] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:12.530557] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=92] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:12.530620] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3526, avg_group_log_size=352) [2025-04-21 14:09:12.530648] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:12.531996] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1464, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:12.532040] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:09:12.532078] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=90, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:12.532127] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:12.532164] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1695, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:12.532195] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:12.532233] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:12.570911] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:12.570968] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:12.572672] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.581065] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=54] gc stale ls task succ [2025-04-21 14:09:12.586200] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=4159488) [2025-04-21 14:09:12.586257] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.586861] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=71] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:12.586935] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=64] temporary file module use no blocks [2025-04-21 14:09:12.586955] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:12.586986] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:12.587013] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254957137068, flush_io_finished_ret_:0, flush_io_finished_round_:144, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:12.598425] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:12.601713] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=30] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:12.601771] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=29) [2025-04-21 14:09:12.605662] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:12.605705] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:12.607102] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:12.607319] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:12.607350] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:12.614819] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:12.614911] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:12.614950] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:12.616630] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:12.616624] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1649, avg_log_submit_to_slide_time=1662) [2025-04-21 14:09:12.616718] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:12.617378] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:09:12.617416] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:12.617458] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:12.642362] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:12.652769] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF001D-0-0] [lt=61] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:12.657243] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=28] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:12.657296] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=50] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:09:12.657315] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:12.657331] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=13] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:12.666381] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=26] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26277518}, readable_log_tail:{lsn:26277518}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40827250, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:12.666511] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=129] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:12.666554] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:12.668868] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01DD-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.670750] WDIAG begin (ob_hashtable.h:954) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8C-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.671175] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01DF-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.672131] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E0-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.672742] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=82][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.673089] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8C-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254958223396, cache_obj->added_lc()=false, cache_obj->get_object_id()=717, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:12.674342] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E2-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.674787] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF013C-0-0] [lt=40][errcode=-4201] hashtable not init [2025-04-21 14:09:12.674824] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF013C-0-0] [lt=35] get cursor info failed(cursor_id=44, get_sessid()=3221487630) [2025-04-21 14:09:12.674997] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF013D-0-0] [lt=27] get number(ret=0, service_type_=0, range=1, base_id=1745215752674720000, start_id=1745215752674720000, end_id=1745215752674720001) [2025-04-21 14:09:12.688200] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=43] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017241600, fast_delete_log_mode=false) [2025-04-21 14:09:12.688923] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E3-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.690860] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E5-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.692053] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] [COMPACTION DAG STATUS] (start_time=1745215742688821, end_time=1745215752692050, dag_status={}) [2025-04-21 14:09:12.692106] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=49] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692129] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692157] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692216] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692235] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692273] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:12.692291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692315] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692353] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692372] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692412] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692431] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692450] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692487] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692580] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692598] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692634] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692670] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692694] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692720] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692766] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692784] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692891] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692912] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692930] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692965] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692978] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.692996] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693055] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693077] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693097] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693115] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693134] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693152] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693171] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693208] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693246] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693265] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693284] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693302] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693321] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693339] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693391] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693410] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693429] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693448] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693496] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693518] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693560] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693579] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693615] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:12.693672] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:12.693702] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:12.693723] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:12.693740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:12.693756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:12.693772] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:12.693788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:12.693804] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:12.693819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:12.693835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:12.693852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:12.694664] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.694736] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.695143] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.695576] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.695695] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.695726] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.696134] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=66] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.696192] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.696238] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.696347] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.696488] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:12.701883] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=73] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}) [2025-04-21 14:09:12.706057] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=21] Garbage Collector is running(seq_=15, gc_interval=10000000) [2025-04-21 14:09:12.706160] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=56] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:12.706206] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=31] gc_check_member_list_ cost time(ret=0, time_us=91) [2025-04-21 14:09:12.706242] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=27] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:12.708100] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=25] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:12.708152] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=44] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:12.708179] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=24] execute_gc cost time(ret=0, time_us=29) [2025-04-21 14:09:12.708202] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyHandler start process [2025-04-21 14:09:12.708224] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:12.708252] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:12.708938] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:12.716467] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1964) [2025-04-21 14:09:12.716557] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1964) [2025-04-21 14:09:12.724413] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDFB-0-0] [lt=53] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:12.724574] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDFD-0-0] [lt=61] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:12.724874] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=51] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:12.755767] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDF9-0-0] [lt=51] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:12.772895] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:12.772927] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=30] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:12.772946] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.788754] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1745215752788562000, start_id=1745215752788562000, end_id=1745215752788562001) [2025-04-21 14:09:12.792166] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=67] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:12.795138] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215752795133, bytes: 4946267, bw: 0.012088 MB/s, add_ts: 1007610, add_bytes: 12772 [2025-04-21 14:09:12.805071] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16339, max_lsn:26278107, max_scn:{val:1745215752692010000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26278107}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26277518}, last_submit_end_lsn:{lsn:26278107}, last_submit_log_id:16339, last_submit_log_pid:3, max_flushed_lsn:{lsn:26277518}, max_flushed_end_lsn:{lsn:26278107}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26278107}, last_slide_log_id:16339, last_slide_scn:{val:1745215752692010000, v:0}, last_slide_lsn:{lsn:26277518}, last_slide_end_lsn:{lsn:26278107}, last_slide_log_pid:3, last_slide_log_accum_checksum:1706498029, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16340, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26278107}, readable_log_tail:{lsn:26278107}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40826661, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:12.805352] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=275] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215752693877, last_flushed_end_lsn:{lsn:26278107}}]) [2025-04-21 14:09:12.805378] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16340, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215752693877, last_flushed_end_lsn:{lsn:26278107}}]) [2025-04-21 14:09:12.807243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:12.814790] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=79] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:12.826477] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:12.834213] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:12.834271] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=50] temporary file module use no blocks [2025-04-21 14:09:12.834290] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:12.834320] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:12.834345] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254957384448, flush_io_finished_ret_:0, flush_io_finished_round_:144, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:12.835223] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=62] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:12.842993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:12.852497] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E7-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.854922] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01E9-0-0] [lt=66][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.870795] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215752870788, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2025-04-21 14:09:12.872889] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.884063] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:12.884147] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.895743] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01EC-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.896468] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01ED-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:12.904627] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=88] BlockGCTimerTask success(ret=0, cost_time_us=16, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:12.905134] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=30] LogLoopThread round_cost_time(us)(round_cost_time=369) [2025-04-21 14:09:12.907111] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE2-0-0] [lt=40] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215752907091}) [2025-04-21 14:09:12.907177] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE2-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215752907172}) [2025-04-21 14:09:12.907189] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE23-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215752907157, sql_renew_time:1745215752907157, is_mark_fail:false}]) [2025-04-21 14:09:12.907263] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE23-0-0] [lt=71] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215752907091}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215752907157, sql_renew_time:1745215752907157, is_mark_fail:false}]) [2025-04-21 14:09:12.907324] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE24-0-0] [lt=44] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:12.907839] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE24-0-0] [lt=34] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215752907823, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:12.907897] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE24-0-0] [lt=55] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215752907172}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215752907823, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:12.908717] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE2-0-0] [lt=24] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:12.913253] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE60-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:12.913316] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE60-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:12.914098] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=35] start to print blacklist info [2025-04-21 14:09:12.914259] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=37] ls blacklist refresh finish(cost_time=8322) [2025-04-21 14:09:12.941943] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4073, offset=78390}, end_cursor:ObLogCursor{file_id=3, log_id=4074, offset=78696}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77570050, len:3530, log_data_len:306, seq:4073, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:12.942314] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6D-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:12.942426] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6D-0-0] [lt=74] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215752719664000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215752719664000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:12.946511] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6D-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:12.948237] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFDFF-0-0] [lt=15] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:12.949711] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=75] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4074, offset=78696}, end_cursor:ObLogCursor{file_id=3, log_id=4075, offset=78993}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77574050, len:3224, log_data_len:297, seq:4074, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:12.950108] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6D-0-0] [lt=56] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:12.950187] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6D-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215752719664000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215752719664000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:12.961805] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:12.961868] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:12.972975] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:12.991092] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215752788562000, v:0}, new_max_version={val:1745215752788562000, v:0}, last_min_version={val:1745215752587682000, v:0}, last_max_version={val:1745215752587682000, v:0}, total_time_us=3899, delta_us=202526) [2025-04-21 14:09:12.991154] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=59] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215752788562000, v:0}, min_version={val:1745215752788562000, v:0}, max_version={val:1745215752788562000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:13.007419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=72] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:13.023997] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=28] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:13.024044] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC3-0-0] [lt=19] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:13.024073] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=75] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:13.024086] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC3-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:13.038595] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=47] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:13.043496] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:13.056758] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=17] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:13.056883] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=75] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:13.056919] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=238, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:13.056997] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=649814016, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=423927808, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:13.057084] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=47] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:13.057109] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=28, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:13.073065] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.086406] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:13.086464] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.173137] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.189440] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3972) [2025-04-21 14:09:13.191778] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF013D-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215753190692000, start_id=1745215753190692000, end_id=1745215753190692001) [2025-04-21 14:09:13.207601] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=80] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:13.220972] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:13.244035] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:13.253886] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCB-0-0] [lt=38] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:13.253952] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCB-0-0] [lt=54] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=68) [2025-04-21 14:09:13.273223] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.275476] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF013E-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.278049] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF013E-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254958828355, cache_obj->added_lc()=false, cache_obj->get_object_id()=718, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:13.287703] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0A-0-0] [lt=33] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:13.287761] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0A-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:13.292714] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1745215753292272000, start_id=1745215753292272000, end_id=1745215753292272001) [2025-04-21 14:09:13.332839] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3972) [2025-04-21 14:09:13.332947] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=84] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1729, avg_log_submit_to_slide_time=1757) [2025-04-21 14:09:13.335016] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE65-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:13.335078] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE65-0-0] [lt=58] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:13.359165] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=14kB/s, net_out=14kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:13.359244] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:13.359421] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:13.359608] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:13.359691] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:19, schedule:39, submit:9, rt:1287, total:1355) [2025-04-21 14:09:13.359772] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:13.359841] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=61] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:19, schedule:39, submit:9, device:1287, total:1355) [2025-04-21 14:09:13.359902] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:13.359977] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:763, total:778) [2025-04-21 14:09:13.360057] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:13.360094] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:763, total:778) [2025-04-21 14:09:13.360155] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:13.360182] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:13.372633] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:13.373307] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.384272] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:13.384330] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.400457] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=53] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:13.401760] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=52] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:13.401858] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215751200391000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:13.412617] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7000000, replace_num=100000) [2025-04-21 14:09:13.412665] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:13.415457] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:13.415517] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:13.415552] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:13.415591] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:13.415621] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:13.417154] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1776, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:13.417225] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1773, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:13.417251] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=82] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:13.417272] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:13.417311] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:13.417352] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1932, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:13.417384] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:13.417422] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:13.417440] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1898, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:13.417460] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:13.422113] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:13.435431] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:13.436159] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:13.436204] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=37] temporary file module use no blocks [2025-04-21 14:09:13.436226] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:13.436254] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:13.436278] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254957986375, flush_io_finished_ret_:0, flush_io_finished_round_:145, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:13.438903] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:13.444582] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:13.455187] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1654, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:13.455240] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:13.455288] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:13.455316] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1795, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:13.455339] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:13.455525] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:13.461995] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:13.462055] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.473375] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.474947] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.475345] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.476049] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=60] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.476109] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.493370] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=16, avg_log_batch_cnt=1, total_group_log_size=8261, avg_group_log_size=516) [2025-04-21 14:09:13.493423] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8261) [2025-04-21 14:09:13.495271] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8261) [2025-04-21 14:09:13.495353] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8261) [2025-04-21 14:09:13.495403] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=16, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1759, avg_log_submit_to_slide_time=1780) [2025-04-21 14:09:13.495472] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8261, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:13.517133] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:13.517212] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1883, avg_log_submit_to_slide_time=1906) [2025-04-21 14:09:13.517296] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:13.531342] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:13.531408] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3971, avg_group_log_size=397) [2025-04-21 14:09:13.531437] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:13.532609] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1659, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:13.532689] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=78] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3971) [2025-04-21 14:09:13.532740] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:13.532810] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:13.532851] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1811, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:13.532884] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:13.532924] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3971, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:13.567326] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:13.567511] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA2-0-0] [lt=76] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215753221114001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:13.567691] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA2-0-0] [lt=139] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:13.567763] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA2-0-0] [lt=68] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:13.573449] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.581156] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:13.586597] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:13.586651] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.587154] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:13.587209] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:13.587227] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:13.587259] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:13.587283] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254958137377, flush_io_finished_ret_:0, flush_io_finished_round_:145, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:13.598593] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:13.605630] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:13.605678] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:13.607373] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:13.607410] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:13.612772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:13.615637] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:13.615706] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:13.615737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:13.617071] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:13.617256] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=9, avg_log_submit_to_flush_time=1865, avg_log_submit_to_slide_time=1878) [2025-04-21 14:09:13.617352] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:13.631796] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=54] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:13.633052] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=54] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:13.633149] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215745589109000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:13.645252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=98] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:13.650891] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCE-0-0] [lt=39] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:13.653157] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0022-0-0] [lt=54] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:13.654538] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=2600000, clean_num=200000) [2025-04-21 14:09:13.660030] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] ====== checkpoint timer task ====== [2025-04-21 14:09:13.661078] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=43] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:13.661140] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:13.661214] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:13.661322] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=107] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:13.661356] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:13.661385] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215744209918001, v:0}) [2025-04-21 14:09:13.661406] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:13.661425] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:13.661458] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:13.661483] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:13.661515] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:13.661550] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:13.662554] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:13.662595] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=41] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:13.662646] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:13.662731] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=83] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:13.662750] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:13.662774] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:13.662794] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:13.662812] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:13.662837] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:13.662864] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:13.662884] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:13.670647] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0140-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.672646] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01EF-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.673093] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0140-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254959223401, cache_obj->added_lc()=false, cache_obj->get_object_id()=719, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:13.673531] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.675110] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01F1-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.675311] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDDF-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.676423] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01F3-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.691808] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01F4-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.693509] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01F6-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.694893] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.695582] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.695760] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=52] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.695819] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.695834] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=56] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.695869] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.696088] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.696088] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.696218] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.696275] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.696570] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:13.703059] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=28] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:13.722178] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=119] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215753722161], gts:1745215753721686000, latest_srr:[mts=1745215753722161]}) [2025-04-21 14:09:13.763516] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA4-0-0] [lt=45] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:13.773610] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.792287] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=45] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:13.802762] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215753802756, bytes: 4960983, bw: 0.013928 MB/s, add_ts: 1007623, add_bytes: 14716 [2025-04-21 14:09:13.812906] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:13.815358] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:09:13.815449] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=80] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:13.815722] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:13.815781] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=57] try gc retain ctx [2025-04-21 14:09:13.815797] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:13.815856] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] finish update min start scn(max_decided_scn={val:1745215753221114004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215743709736000, v:0}, keep_alive_scn_:{val:1745215748715893000, v:0}, update_ts_:1745215753815621}) [2025-04-21 14:09:13.816787] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215760473222000, latest_log_ts:{val:1745215744209918001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:13.816970] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=104] finish update min start scn(max_decided_scn={val:1745215753221114004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215743709736000, v:0}, keep_alive_scn_:{val:1745215748715893000, v:0}, update_ts_:1745215753816696}) [2025-04-21 14:09:13.817948] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215750717747001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:13.819217] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:09:13.819307] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:09:13.826548] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=62] gc stale ls task succ [2025-04-21 14:09:13.834483] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:13.834533] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:13.834552] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:13.834574] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:13.834593] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254958384707, flush_io_finished_ret_:0, flush_io_finished_round_:145, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:13.835395] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:13.855161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:13.856332] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01F8-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.858645] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01FA-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.862869] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:09:13.873692] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.878416] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=64] PNIO [ratelimit] time: 1745215753878410, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2025-04-21 14:09:13.884445] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:13.884507] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.900395] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01FD-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.901096] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F01FE-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:13.914715] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE61-0-0] [lt=21] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:13.914783] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE61-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:13.917409] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=62, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:13.917458] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=48] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1653, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:13.917474] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:13.917487] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=-598, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:13.917506] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=18] [APPLY STAT CB TOTAL TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1117, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:13.930092] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=45] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:13.932047] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=70] get number(ret=0, service_type_=0, range=1, base_id=1745215753932009000, start_id=1745215753932009000, end_id=1745215753932009001) [2025-04-21 14:09:13.956279] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=74] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4075, offset=78993}, end_cursor:ObLogCursor{file_id=3, log_id=4076, offset=79299}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77578050, len:2927, log_data_len:306, seq:4075, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:13.956593] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=58] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:13.956646] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=32] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215753721686000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215753721686000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:13.959593] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=44] current monitor number(seq_=-1) [2025-04-21 14:09:13.959847] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=14] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=1, MAX_GAP=900000000000, new_sync_scn={val:1745215752719664001, v:0}, new_replayable_scn={val:1745215752719664001, v:0}, new_readable_scn={val:1745215752719664000, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215751726536001, replayable_scn:1745215751726536001, readable_scn:1745215751726536000, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:13.960250] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=52] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:13.962158] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:13.962218] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:13.963001] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=66] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4076, offset=79299}, end_cursor:ObLogCursor{file_id=3, log_id=4077, offset=79596}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7757c050, len:2621, log_data_len:297, seq:4076, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:13.963378] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:13.963422] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6E-0-0] [lt=27] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215753721686000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215753721686000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:13.973758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:13.991228] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=68] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215753789073000, v:0}, new_max_version={val:1745215753789073000, v:0}, last_min_version={val:1745215753588873000, v:0}, last_max_version={val:1745215753588873000, v:0}, total_time_us=3265, delta_us=202152) [2025-04-21 14:09:13.991278] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215753789073000, v:0}, min_version={val:1745215753789073000, v:0}, max_version={val:1745215753789073000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:13.991734] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215753221114004, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=770596, in_cluster_service=true, cluster_version={val:1745215753221114003, v:0}, min_cluster_version={val:1745215753221114003, v:0}, max_cluster_version={val:1745215753221114003, v:0}, get_cluster_version_err=0, cluster_version_delta=770596, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1304, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=84867446, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:14.013056] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:14.038744] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=58] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:14.054835] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:14.055733] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:14.073830] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.084176] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:14.084248] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=65] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:14.084269] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:14.084295] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=23] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:14.086771] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:14.086821] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.087515] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:14.087874] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=355] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:14.088064] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] get_max_applied_scn(scn={val:1745215753988811000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65864528}, palf_committed_end_scn_:{val:1745215753988811000, v:0}, last_check_scn_:{val:1745215753988811000, v:0}, max_applied_cb_scn_:{val:1745215753988811000, v:0}}) [2025-04-21 14:09:14.088123] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65864528}, readable_log_tail:{lsn:65864528}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1240240, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:14.173901] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.189879] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=98] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3533) [2025-04-21 14:09:14.213193] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:14.222459] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=48] ts response task statistics(alloc_count=3246, free_count=1622) [2025-04-21 14:09:14.222543] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=66] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:14.222865] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=33] submit log success(service_type_=0, last_id=1745215770473222000, limited_id=1745215770473222000) [2025-04-21 14:09:14.222893] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=28] submit log with lock success(service_type_=0, last_id=1745215770473222000, limited_id=1745215770473222000) [2025-04-21 14:09:14.222928] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=413, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:14.224134] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215770473222000, latest_scn={val:1745215754222578001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215751726536001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:14.224229] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=93] handle submit callback(service_type_=0, success=true, used_ts=1364, log_ts={val:1745215754222578001, v:0}, limited_id=1745215770473222000) [2025-04-21 14:09:14.224256] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=26] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:14.224279] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=21] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:14.240908] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=34] [APPLY STAT CB APPEND COST TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=53, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:14.240951] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=42] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=1710, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:14.240966] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:14.240985] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=-468, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:14.241019] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=33] [APPLY STAT CB TOTAL TIME](cur_stat_count=75, stat_interval=5000000, avg (count/cost)=1295, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:14.255649] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] get_max_applied_scn(scn={val:1745215754093012000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26291987}, palf_committed_end_scn_:{val:1745215754253609000, v:0}, last_check_scn_:{val:1745215754253609000, v:0}, max_applied_cb_scn_:{val:1745215754093012000, v:0}}) [2025-04-21 14:09:14.255706] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26291987}, readable_log_tail:{lsn:26291987}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40812781, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:14.256292] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:14.273985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.282171] WDIAG begin (ob_hashtable.h:954) [620065][T1_L0_G0][T1][YB420B1D7AB6-00063343B8BEFD89-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.284646] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620065][T1_L0_G0][T1][YB420B1D7AB6-00063343B8BEFD89-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254959834929, cache_obj->added_lc()=false, cache_obj->get_object_id()=720, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:14.289604] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0B-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:14.289660] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0B-0-0] [lt=53] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:14.295641] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=126] get_max_applied_scn(scn={val:1745215753721686003, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17377613}, palf_committed_end_scn_:{val:1745215754222578001, v:0}, last_check_scn_:{val:1745215754222578001, v:0}, max_applied_cb_scn_:{val:1745215753721686003, v:0}}) [2025-04-21 14:09:14.295703] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17377613}, readable_log_tail:{lsn:17377613}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49727155, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:14.295973] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=54] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:14.317598] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=24] [APPLY STAT CB APPEND COST TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=34, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:14.317647] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=48] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=1639, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:14.317663] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:14.317675] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-525, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:14.317688] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F01D3-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=1147, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:14.333105] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3533) [2025-04-21 14:09:14.333175] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1650, avg_log_submit_to_slide_time=1671) [2025-04-21 14:09:14.336704] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE66-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:14.336770] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE66-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:14.361237] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=130] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:14.361300] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:14.361482] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:14.361668] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:14.361765] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:15, schedule:32, submit:8, rt:1227, total:1283) [2025-04-21 14:09:14.361841] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:14.361909] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:15, schedule:32, submit:8, device:1227, total:1283) [2025-04-21 14:09:14.361974] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:14.362060] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:893, total:910) [2025-04-21 14:09:14.362145] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:14.362185] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:893, total:910) [2025-04-21 14:09:14.362247] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:14.362274] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:14.374067] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.384674] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:14.384746] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.390545] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=61] clear dtl interm result cost(us)(clear_cost=24, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:14.390753] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620159][T1001_ObXAHbWor][T1001][Y0-0000000000000000-0-0] [lt=44] XA scheduler heartbeat task statistics(avg_time=4) [2025-04-21 14:09:14.392208] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=104] get_max_applied_scn(scn={val:1745215753721686004, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:8794296}, palf_committed_end_scn_:{val:1745215754222578000, v:0}, last_check_scn_:{val:1745215754222578000, v:0}, max_applied_cb_scn_:{val:1745215753721686004, v:0}}) [2025-04-21 14:09:14.392364] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=146] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:8794296}, readable_log_tail:{lsn:8794296}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:58310472, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:14.396336] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620177][T1001_Compactio][T1001][YB420B1D7AB6-00063343B7CEFD8A-0-0] [lt=38] InfoPoolResizeTask(cost_ts=15) [2025-04-21 14:09:14.400662] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:14.400728] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=48] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:14.400768] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=35] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=30) [2025-04-21 14:09:14.401386] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:14.401538] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA3-0-0] [lt=48] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215754293128000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:14.401667] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA3-0-0] [lt=121] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:14.405557] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:14.405610] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=44] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:14.413346] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:14.416267] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=71] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:14.416338] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:14.416380] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:14.416416] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:14.417762] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1448, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:14.417828] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:14.417862] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1436, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:14.417883] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:14.417930] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1599, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:14.417933] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:14.417971] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:14.418026] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:14.418050] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1561, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:14.418068] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:14.421795] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:14.421947] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=47][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:14.422186] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:14.423596] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215754421978) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215754421978) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:14.424843] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:09:14.435606] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:14.439743] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:14.443194] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:09:14.444167] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:14.444231] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=63] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:14.444304] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=36] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:14.444408] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=100] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:14.444455] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:14.444483] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215751290420001, v:0}) [2025-04-21 14:09:14.444513] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:14.444534] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:14.444558] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:14.444590] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:14.444615] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:14.444648] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:14.444682] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:14.444704] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:14.455734] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1463, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:14.455787] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:14.455833] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:14.455858] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1575, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:14.455887] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:14.456837] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=66] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:14.462326] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:14.462380] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.474130] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.475452] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.475978] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=68] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.476138] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.476199] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.493688] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=170] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8807, avg_group_log_size=518) [2025-04-21 14:09:14.493734] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8807) [2025-04-21 14:09:14.516352] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1339, avg_group_log_size=121) [2025-04-21 14:09:14.517803] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1217) [2025-04-21 14:09:14.517871] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1533, avg_log_submit_to_slide_time=1554) [2025-04-21 14:09:14.517957] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1217, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:14.523439] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=58] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:14.531331] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=42] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:14.532026] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:14.532083] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:14.532116] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:14.533307] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1505, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:14.533346] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:14.533384] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:14.533433] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:14.533474] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1651, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:14.533507] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:14.533547] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:14.571114] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:14.571177] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=54] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=152) [2025-04-21 14:09:14.574209] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.581244] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:14.586964] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=4159488) [2025-04-21 14:09:14.587021] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.587429] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:14.587485] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:14.587509] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:14.587535] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:14.587560] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254959137646, flush_io_finished_ret_:0, flush_io_finished_round_:146, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:14.598788] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:14.605741] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:14.605781] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:14.607589] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:14.607626] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:14.613485] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:14.616431] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:14.616533] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:14.616571] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:14.618095] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1217) [2025-04-21 14:09:14.618231] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1532, avg_log_submit_to_slide_time=1544) [2025-04-21 14:09:14.618301] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:14.618963] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=18] ====== tenant freeze timer task ====== [2025-04-21 14:09:14.619013] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=33554432, ctx.total_memstore_used_=67108864, ctx.total_memstore_hold_=67108864, memstore_freeze_trigger_limit_=62525420, tenant_id=1002) [2025-04-21 14:09:14.619066] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:14.639819] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=59] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:14.639881] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=60] try gc retain ctx [2025-04-21 14:09:14.639897] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:14.639974] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=27] finish update min start scn(max_decided_scn={val:1745215754493338000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215744485233001, v:0}, keep_alive_scn_:{val:1745215749489253001, v:0}, update_ts_:1745215754639938}) [2025-04-21 14:09:14.640961] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=40] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:14.642640] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8920) [2025-04-21 14:09:14.642751] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8920) [2025-04-21 14:09:14.642809] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=18, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1521, avg_log_submit_to_slide_time=1538) [2025-04-21 14:09:14.642878] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8920, hit_cnt=18, read_cnt=18, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:14.654245] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0027-0-0] [lt=106] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:14.654601] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=22] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:14.654650] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=31] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=28) [2025-04-21 14:09:14.655118] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:14.655169] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:14.655198] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:14.655218] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=28) [2025-04-21 14:09:14.656211] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:14.657465] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:14.674279] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.676954] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0200-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.677445] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0201-0-0] [lt=71][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.679099] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0204-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.679349] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0205-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.689670] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:14.689736] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=48] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=30) [2025-04-21 14:09:14.693188] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=25] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:14.693247] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=47] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:14.693270] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=30) [2025-04-21 14:09:14.694723] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0206-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.694948] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695756] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695849] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695871] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695918] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695948] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695970] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.695993] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=53] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.696076] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.696123] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.696158] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:14.696908] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0208-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.706997] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=43] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):152, sequence:1}) [2025-04-21 14:09:14.710239] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=38][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:14.713953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=20] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000) [2025-04-21 14:09:14.714024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=70] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.714970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.715938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.716988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=39] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.717859] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:14.717955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.718979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.719980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.720944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.721957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.722959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723173] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723267] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=399, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:14.723320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723318] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215754723251], gts:1745215754722745000, latest_srr:[mts=1745215754723251]}) [2025-04-21 14:09:14.723388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723524] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723764] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.723969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.724995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725424] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.725970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726583] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.726932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.727952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728843] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.728980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.729969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730450] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.730948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.731987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.732959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733387] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.733965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.734963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.735982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736050] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.736937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.737983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738322] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.738949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.739987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740810] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.740947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.741945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.742991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743059] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743738] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.743942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.744977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.745948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.746997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.747961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748099] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.748996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749293] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.749995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750140] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.750987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.751957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.752992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753428] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.753973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.754945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755845] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.755980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.756951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757172] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:14.757250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.757998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.758971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759081] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=54] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:14.759110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759204] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=46] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215748781280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:14.759261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.759954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760299] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.760991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.761977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.762966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763015] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=120] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:14.763037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763663] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.763940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.764962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.765944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.766971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.767935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=48] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.768982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.769967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.770937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771146] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.771982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.772956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773121] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.773941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774009] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=71][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.774425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.774989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775272] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.775965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.776985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=65] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.777997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778829] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.778964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.779938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213948781280000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213938772378000, max_merged_snapshot=1) [2025-04-21 14:09:14.780778] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8A-0-0] [lt=21] SSTableGCTask(cost_ts=67233) [2025-04-21 14:09:14.792417] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:14.810382] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=71] PNIO [ratelimit] time: 1745215754810376, bytes: 4973755, bw: 0.012088 MB/s, add_ts: 1007620, add_bytes: 12772 [2025-04-21 14:09:14.813622] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:14.826632] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:09:14.834716] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:14.834769] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:14.834787] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:14.834814] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:14.834838] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254959384947, flush_io_finished_ret_:0, flush_io_finished_round_:146, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:14.835551] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:14.857993] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43601018880, global_cache_size=253853696, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:14.860184] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F020A-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.862199] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F020C-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.874447] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.884891] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:14.884983] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=79] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.886030] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215754886025, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007615, add_bytes: 0 [2025-04-21 14:09:14.904749] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F020F-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.905433] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0210-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:14.916160] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE62-0-0] [lt=22] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:14.916227] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE62-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:14.917891] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=48] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:14.918250] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:14.918328] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:09:14.918429] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:14.918461] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=27] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:14.918483] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:14.918505] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:14.921752] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=16] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:14.922454] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=698] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:14.925317] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=64] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:14.939263] WDIAG [SQL.PC] erase_cache_obj (ob_lib_cache_object_manager.cpp:111) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=42][errcode=-4201] failed to erase cache obj(ret=-4201, id=293) [2025-04-21 14:09:14.939331] WDIAG [SQL.PC] remove_cache_obj_stat_entry (ob_plan_cache.cpp:1851) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=65][errcode=-4201] failed to erase plan statistic entry(ret=-4201, cache_obj_id=293) [2025-04-21 14:09:14.939354] WDIAG [SQL.PC] remove_all_plan_stat (ob_i_lib_cache_node.cpp:77) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=22][errcode=-4201] failed to remove plan stat(obj->get_object_id()=293, ret=-4201) [2025-04-21 14:09:14.939407] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=32] has identical pcv(is_same=true, pcv=0x7f3bca328c40) [2025-04-21 14:09:14.939398] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8F-0-0] [lt=33] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200345}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.939400] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=30] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200348}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.939479] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=36][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.939512] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=30][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f44ec20, obj=0x7f3bc859a050) [2025-04-21 14:09:14.939541] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=42][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.939542] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8F-0-0] [lt=43][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.939573] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8F-0-0] [lt=25] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200345}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.939578] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=31] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200348}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.939676] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=21] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200327}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.939707] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD8F-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1745215754939174000, start_id=1745215754939174000, end_id=1745215754939174001) [2025-04-21 14:09:14.939752] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=30][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.939745] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=30] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200349}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.939780] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=24] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200327}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.939869] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=42][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.939917] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=40] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200349}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940023] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=19] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200347}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940032] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=33] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200339}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940129] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=43][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940137] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=37][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940163] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200347}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940169] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=26] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200339}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940263] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=35] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200341}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940287] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=30] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200321}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940364] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=37][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940382] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=36][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940396] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200341}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940416] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200321}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940406] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=19] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200350}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940499] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=28] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200331}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940516] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200337}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940520] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=40][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940550] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=24] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200350}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940586] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=26][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940608] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=18] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200337}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940667] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=18] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200335}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940585] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=33][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940710] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=117] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200331}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940725] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=22][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940745] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=16] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200335}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940796] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=14] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200325}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940851] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=20][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940872] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=18] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200325}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.940841] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200329}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940938] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200343}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.940968] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=62][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.940970] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=35] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200323}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.941001] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200329}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.941029] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=23][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.941059] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=24] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200343}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.941095] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=53][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.941130] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0211-0-0] [lt=29] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200323}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.941141] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200332}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.941199] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=50] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200333}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.941216] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=30][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.941236] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=17] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200332}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.941302] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=33][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.941337] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=28] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200333}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.941454] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE0-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215754941311000, start_id=1745215754941311000, end_id=1745215754941311001) [2025-04-21 14:09:14.941527] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAD-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215754941311000, start_id=1745215754941311001, end_id=1745215754941311002) [2025-04-21 14:09:14.941933] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=26] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200328}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.942034] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=38][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.942069] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=29] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200328}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.942152] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=26] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200338}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.942240] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=32][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.942269] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE1-0-0] [lt=24] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200338}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.943113] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=30] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200324}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.943221] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=42][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.943252] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=26] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200324}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.943899] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=17] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200326}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.943974] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=23][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.943993] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=15] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200326}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.944047] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=15] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200344}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.944100] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=16][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.944117] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0212-0-0] [lt=13] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200344}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.944694] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=24] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200340}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.944826] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=58][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.944865] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=31] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200340}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.945695] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=32] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200342}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.945809] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=51][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.945788] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAE-0-0] [lt=37] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200346}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.945847] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=33] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200342}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.945933] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=27] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200336}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.945983] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAE-0-0] [lt=72][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.946021] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=35][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.946018] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAE-0-0] [lt=28] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200346}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.946046] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=21] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200336}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.946202] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=19] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:200322}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214133661975000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.946301] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=39][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.946330] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE2-0-0] [lt=24] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1001}, tablet_id={id:200322}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.955152] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=14][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:201369}, ls_id={id:-1}) [2025-04-21 14:09:14.955152] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=25][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:201344}, ls_id={id:-1}) [2025-04-21 14:09:14.955211] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=51][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:09:14.955211] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=57][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:09:14.955279] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=27][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:201368}, ls_id={id:-1}) [2025-04-21 14:09:14.955334] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=53][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:09:14.956789] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=21] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:201369}}, ls_id:{id:1001}, renew_time:1745215754956698, transfer_seq:0}) [2025-04-21 14:09:14.956803] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=16] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:201344}}, ls_id:{id:1001}, renew_time:1745215754956698, transfer_seq:0}) [2025-04-21 14:09:14.957028] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=15] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:201368}}, ls_id:{id:1001}, renew_time:1745215754956908, transfer_seq:0}) [2025-04-21 14:09:14.957524] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=31][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:201365}, ls_id={id:-1}) [2025-04-21 14:09:14.957568] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=42][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:09:14.958237] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=27] LOCATION: block refresh table cache succ(tablet_id={id:201344}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754958227, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:09:14.958252] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=30] LOCATION: block refresh table cache succ(tablet_id={id:201369}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754958246, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:09:14.958483] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=30] LOCATION: block refresh table cache succ(tablet_id={id:201368}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754958474, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:09:14.958934] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=22] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:201365}}, ls_id:{id:1001}, renew_time:1745215754958874, transfer_seq:0}) [2025-04-21 14:09:14.960315] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:1763) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=19] worker thread created(id_=1002, token=7) [2025-04-21 14:09:14.960316] INFO [SHARE] pre_run (ob_tenant_base.cpp:320) [624915][][T1002][Y0-0000000000000000-0-0] [lt=0] tenant thread pre_run(MTL_ID()=1002, ret=0, thread_count_=151) [2025-04-21 14:09:14.960354] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=40] LOCATION: block refresh table cache succ(tablet_id={id:201365}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754960348, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:09:14.960377] INFO [RPC.OBRPC] th_init (ob_rpc_translator.cpp:33) [624915][][T1002][Y0-0000000000000000-0-0] [lt=55] Init thread local success [2025-04-21 14:09:14.962224] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=49] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201344}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.962228] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=38] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201369}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.962253] WDIAG [SHARE.LOCATION] nonblock_get (ob_location_service.cpp:212) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=23][errcode=-4723] fail to nonblock get tablet to log stream(ret=-4723, ret="OB_MAPPING_BETWEEN_TABLET_AND_LS_NOT_EXIST", tenant_id=1002, tablet_id={id:201370}, ls_id={id:-1}) [2025-04-21 14:09:14.962291] WDIAG [SQL.DAS] nonblock_get (ob_das_location_router.cpp:899) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=37][errcode=-4723] nonblock get ls id failed(ret=-4723) [2025-04-21 14:09:14.962336] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=51] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201368}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.963091] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=42] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201365}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.963192] WDIAG [SQL.PC] erase_cache_obj (ob_lib_cache_object_manager.cpp:111) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=48][errcode=-4201] failed to erase cache obj(ret=-4201, id=296) [2025-04-21 14:09:14.963231] WDIAG [SQL.PC] remove_cache_obj_stat_entry (ob_plan_cache.cpp:1851) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=38][errcode=-4201] failed to erase plan statistic entry(ret=-4201, cache_obj_id=296) [2025-04-21 14:09:14.963247] WDIAG [SQL.PC] remove_all_plan_stat (ob_i_lib_cache_node.cpp:77) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=15][errcode=-4201] failed to remove plan stat(obj->get_object_id()=296, ret=-4201) [2025-04-21 14:09:14.963244] WDIAG [SQL.PC] erase_cache_obj (ob_lib_cache_object_manager.cpp:111) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=50][errcode=-4201] failed to erase cache obj(ret=-4201, id=297) [2025-04-21 14:09:14.963273] WDIAG [SQL.PC] remove_cache_obj_stat_entry (ob_plan_cache.cpp:1851) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=29][errcode=-4201] failed to erase plan statistic entry(ret=-4201, cache_obj_id=297) [2025-04-21 14:09:14.963280] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=13] has identical pcv(is_same=true, pcv=0x7f3bca396630) [2025-04-21 14:09:14.963298] WDIAG [SQL.PC] remove_all_plan_stat (ob_i_lib_cache_node.cpp:77) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=23][errcode=-4201] failed to remove plan stat(obj->get_object_id()=297, ret=-4201) [2025-04-21 14:09:14.963310] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=21][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.963307] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=37][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.963330] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=19][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f44ec20, obj=0x7f3bc85f6050) [2025-04-21 14:09:14.963345] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0213-0-0] [lt=31] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201369}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.963372] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=21] has identical pcv(is_same=true, pcv=0x7f3bca396630) [2025-04-21 14:09:14.963402] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=23][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.963424] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=21][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f4ccc20, obj=0x7f3bca336050) [2025-04-21 14:09:14.963451] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=19][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.963476] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE3-0-0] [lt=20] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201344}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.963606] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=20][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.963643] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDAF-0-0] [lt=30] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201368}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.963731] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0214-0-0] [lt=25][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.963768] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0214-0-0] [lt=32] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201365}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.963771] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE4-0-0] [lt=22] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201361}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.963788] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=50] has identical pcv(is_same=true, pcv=0x7f3bca396630) [2025-04-21 14:09:14.963839] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=39][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.963853] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE4-0-0] [lt=31][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.963873] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=38] current monitor number(seq_=-1) [2025-04-21 14:09:14.963869] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=27][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f54ac20, obj=0x7f3bc859a050) [2025-04-21 14:09:14.963876] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE4-0-0] [lt=19] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201361}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.964040] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB0-0-0] [lt=27] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201349}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.964064] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFD90-0-0] [lt=26][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254960514347, cache_obj->added_lc()=false, cache_obj->get_object_id()=298, cache_obj->get_tenant_id()=1002, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:14.964109] INFO [SHARE.LOCATION] renew_cache_ (ob_tablet_ls_service.cpp:391) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=14] [TABLET_LOCATION]success to renew tablet cache(tablet_cache={cache_key:{tenant_id:1002, tablet_id:{id:201370}}, ls_id:{id:1001}, renew_time:1745215754964034, transfer_seq:0}) [2025-04-21 14:09:14.964118] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:14.964131] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB0-0-0] [lt=39][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.964156] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=30] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:14.964160] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB0-0-0] [lt=24] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201349}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.964361] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0215-0-0] [lt=22] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201359}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.964447] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0215-0-0] [lt=33][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.964466] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0215-0-0] [lt=15] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201359}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.964657] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0216-0-0] [lt=15] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201341}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.964710] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE5-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201347}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.964722] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0216-0-0] [lt=20][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.964745] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0216-0-0] [lt=19] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201341}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.964788] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE5-0-0] [lt=32][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.964806] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE5-0-0] [lt=14] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201347}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.964958] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE6-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201348}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.965055] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE6-0-0] [lt=32][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.965078] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE6-0-0] [lt=19] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201348}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.965581] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0219-0-0] [lt=15] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201358}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.965662] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0219-0-0] [lt=34][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.965644] INFO [SQL.DAS] block_renew_tablet_location (ob_das_location_router.cpp:1289) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=38] LOCATION: block refresh table cache succ(tablet_id={id:201370}, ls_loc={cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754965635, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}) [2025-04-21 14:09:14.965688] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0219-0-0] [lt=21] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201358}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.966530] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE8-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201360}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.966577] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB2-0-0] [lt=17] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201345}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.966619] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE8-0-0] [lt=29][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.966653] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDE8-0-0] [lt=28] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201360}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.966672] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB2-0-0] [lt=37][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.966717] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB2-0-0] [lt=40] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201345}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.966892] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB3-0-0] [lt=30] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201357}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.966976] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB3-0-0] [lt=35][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.966970] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEA-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201367}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.967006] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB3-0-0] [lt=25] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201357}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.967042] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEA-0-0] [lt=28][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.967060] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEA-0-0] [lt=15] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201367}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.967087] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=43] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201370}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:14.967378] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEB-0-0] [lt=15] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201363}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.967450] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEB-0-0] [lt=27][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.967473] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEB-0-0] [lt=19] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201363}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.967618] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEC-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201355}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.967625] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB5-0-0] [lt=16] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201353}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754945631001) [2025-04-21 14:09:14.967684] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEC-0-0] [lt=26][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.967706] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDEC-0-0] [lt=18] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201355}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.967714] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB5-0-0] [lt=32][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.967742] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB5-0-0] [lt=24] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201353}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.967771] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=36] has identical pcv(is_same=true, pcv=0x7f3bca396630) [2025-04-21 14:09:14.967814] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=32][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.967839] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=23][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c2094ac20, obj=0x7f3bc85a0050) [2025-04-21 14:09:14.967961] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=20][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.967994] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=27] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201370}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.968181] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD86-0-0] [lt=18][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254960518407, cache_obj->added_lc()=false, cache_obj->get_object_id()=299, cache_obj->get_tenant_id()=1002, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:14.968415] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB6-0-0] [lt=23] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201351}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754968034001) [2025-04-21 14:09:14.968510] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB6-0-0] [lt=39][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.968541] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDB6-0-0] [lt=25] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201351}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.969457] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD8D-0-0] [lt=20] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201343}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754968034001) [2025-04-21 14:09:14.969551] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD8D-0-0] [lt=38][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.969579] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD8D-0-0] [lt=24] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201343}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.970299] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4077, offset=79596}, end_cursor:ObLogCursor{file_id=3, log_id=4078, offset=79902}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77580050, len:2324, log_data_len:306, seq:4077, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:14.970674] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6F-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:14.970815] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6F-0-0] [lt=108] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215754722745000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215754722745000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:14.970924] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD93-0-0] [lt=23] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201352}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754968034001) [2025-04-21 14:09:14.971013] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD93-0-0] [lt=37][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.971034] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFD93-0-0] [lt=16] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201352}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.974006] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE6F-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:14.974527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:14.978719] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDA7-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1745215754975051000, start_id=1745215754975051000, end_id=1745215754975051001) [2025-04-21 14:09:14.979647] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4078, offset=79902}, end_cursor:ObLogCursor{file_id=3, log_id=4079, offset=80199}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77584050, len:2018, log_data_len:297, seq:4078, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:14.980135] INFO [SQL.PC] inner_add_cache_obj (ob_pcv_set.cpp:247) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDF4-0-0] [lt=20] has identical pcv(is_same=true, pcv=0x7f3bc85c4960) [2025-04-21 14:09:14.980188] WDIAG [SQL.PC] add_cache_obj (ob_plan_set.cpp:1182) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDF4-0-0] [lt=45][errcode=-5136] failed to add plan.(ret=-5136) [2025-04-21 14:09:14.980216] WDIAG [SQL.PC] add_cache_obj (ob_i_lib_cache_node.cpp:115) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDF4-0-0] [lt=24][errcode=-5136] failed to inner add cache obj(ret=-5136, key=0x7f3c1f44ec20, obj=0x7f3bc859c050) [2025-04-21 14:09:14.980509] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6F-0-0] [lt=54] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:14.980595] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE6F-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215754722745000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215754722745000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:14.986150] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDF4-0-0] [lt=21][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254960536449, cache_obj->added_lc()=false, cache_obj->get_object_id()=302, cache_obj->get_tenant_id()=1002, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:14.988859] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDAD-0-0] [lt=25] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201362}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754987627003) [2025-04-21 14:09:14.989094] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDAD-0-0] [lt=76][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.989148] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDAD-0-0] [lt=45] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201362}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.989793] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDB0-0-0] [lt=36] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201356}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754988708001) [2025-04-21 14:09:14.989952] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDB0-0-0] [lt=58][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.990002] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDB0-0-0] [lt=42] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201356}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:14.997777] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDC5-0-0] [lt=35] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201346}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754994110003) [2025-04-21 14:09:14.997977] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDC5-0-0] [lt=77][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:14.998034] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDC5-0-0] [lt=46] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201346}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:15.000222] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=79] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:15.001864] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDD4-0-0] [lt=40] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201366}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215754994110003) [2025-04-21 14:09:15.002041] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDD4-0-0] [lt=62][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:15.002094] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDD4-0-0] [lt=45] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201366}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:15.002769] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215754790210000, v:0}, new_max_version={val:1745215754790210000, v:0}, last_min_version={val:1745215754589413000, v:0}, last_max_version={val:1745215754589413000, v:0}, total_time_us=12410, delta_us=212554) [2025-04-21 14:09:15.002841] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=67] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215754790210000, v:0}, min_version={val:1745215754790210000, v:0}, max_version={val:1745215754790210000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:15.005830] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDE2-0-0] [lt=28] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201364}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215755004907002) [2025-04-21 14:09:15.005972] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDE2-0-0] [lt=57][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:15.006022] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDE2-0-0] [lt=42] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201364}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:15.012080] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDFC-0-0] [lt=54] refresh tablet status cache(ret=0, ls_id={id:1001}, tablet_id={id:201342}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745214139886260000, delete_commit_version:-1}, snapshot_version=1745215755005993000) [2025-04-21 14:09:15.012206] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDFC-0-0] [lt=50][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:15.012242] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFDFC-0-0] [lt=29] refresh ddl data cache(ret=0, ls_id={id:1001}, tablet_id={id:201342}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:15.013837] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:15.026363] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:15.026391] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8C-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:15.026428] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=63] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:15.026444] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8C-0-0] [lt=46] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:15.035599] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F021B-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215755035007000, start_id=1745215755035007000, end_id=1745215755035007001) [2025-04-21 14:09:15.039222] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=58] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:15.058515] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43590533120, global_cache_size=255934464, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:15.074604] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.081196] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=60] LogLoopThread round_cost_time(us)(round_cost_time=30) [2025-04-21 14:09:15.087151] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:15.087221] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.174673] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.192159] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:15.213994] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:15.223784] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215755223754], gts:1745215755222743000, latest_srr:[mts=1745215755223754]}) [2025-04-21 14:09:15.223849] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=63] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:15.254474] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCC-0-0] [lt=41] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:15.254545] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCC-0-0] [lt=60] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=72) [2025-04-21 14:09:15.256131] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215755057220000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198898, in_cluster_service=true, cluster_version={val:1745215754857013000, v:0}, min_cluster_version={val:1745215754857013000, v:0}, max_cluster_version={val:1745215754857013000, v:0}, get_cluster_version_err=0, cluster_version_delta=399105, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1316, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=90076711, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:15.258615] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDD9-0-0] [lt=56] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.259028] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:15.261436] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=37] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:15.261557] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=118] check all tenants(ret=0) [2025-04-21 14:09:15.262849] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDDC-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.264176] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDDD-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.265489] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDDE-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.266771] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDDF-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.268069] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE0-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.269370] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE1-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.270647] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE2-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.274742] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.288464] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0143-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.290811] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0143-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254960841119, cache_obj->added_lc()=false, cache_obj->get_object_id()=721, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:15.291120] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0C-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:15.291169] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0C-0-0] [lt=46] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:15.334219] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:15.334311] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=66] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=2696, avg_log_submit_to_slide_time=2720) [2025-04-21 14:09:15.338522] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE67-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:15.338587] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE67-0-0] [lt=62] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.363980] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:15.364044] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:15.364222] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:15.364396] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:15.364482] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8169, [delay/us]:prepare:18, schedule:152, submit:11, rt:1914, total:2095) [2025-04-21 14:09:15.364558] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:15.364634] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8169, [delay/us]: prepare:18, schedule:152, submit:11, device:1914, total:2095) [2025-04-21 14:09:15.364712] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:15.364784] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4084, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:675, total:690) [2025-04-21 14:09:15.364865] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:15.364901] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4084, [delay/us]: prepare:0, schedule:0, submit:600000000, device:675, total:690) [2025-04-21 14:09:15.364954] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=10] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:15.364979] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:15.371481] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=53] success to update min reserved snapshot(reserved_snapshot=1745213948781280000, duration=1800, snapshot_gc_ts=1745215748781280000) [2025-04-21 14:09:15.371621] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=56] success to update min reserved snapshot(reserved_snapshot=1745213945589109000, duration=1800, snapshot_gc_ts=1745215745589109000) [2025-04-21 14:09:15.373196] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] update reserved snapshot finished(cost_ts=1582, reserved_snapshot=1745213945589109000) [2025-04-21 14:09:15.373236] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=64] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213948781280000) [2025-04-21 14:09:15.373271] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] update reserved snapshot finished(cost_ts=1797, reserved_snapshot=1745213948781280000) [2025-04-21 14:09:15.374778] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.385049] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:15.385101] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.387382] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:15.387801] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:15.388692] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDA4-0-0] [lt=39] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:15.389239] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215755388332000, start_id=1745215755388332000, end_id=1745215755388332001) [2025-04-21 14:09:15.390633] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65873099, this={dio_aligned_buf:{buf_write_offset:1772, buf_padding_size:2324, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3898, truncate_used_ts:1603}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65871872, buf_len=545, total_write_size=38271, total_write_size_after_dio=466944, ob_pwrite_used_ts=188698, count=105, each_pwrite_cost=1797) [2025-04-21 14:09:15.414136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:15.417489] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:15.417549] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:15.417580] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:15.417608] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=330, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:15.418789] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1381, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:15.418844] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:15.418908] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:15.418928] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT WRITE LOG COST TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=1149, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:15.418956] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1534, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:15.418960] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:15.418983] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:15.419027] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:15.419055] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=2094, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:15.419086] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=225, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:15.422269] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:15.435787] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:15.436493] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:15.436550] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:15.436570] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:15.436598] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:15.436623] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254959986719, flush_io_finished_ret_:0, flush_io_finished_round_:147, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:15.440436] INFO [LIB] stat (utility.h:1176) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=122] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:15.459328] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1360, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:15.459389] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:15.459486] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:15.459545] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1530, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:15.459580] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:15.459591] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:15.464320] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:15.464374] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.474863] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.475041] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.475225] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.475297] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.475815] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=59] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.494583] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=8364, avg_group_log_size=492) [2025-04-21 14:09:15.494632] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8364) [2025-04-21 14:09:15.517590] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=8, avg_log_batch_cnt=1, total_group_log_size=976, avg_group_log_size=122) [2025-04-21 14:09:15.519551] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=976) [2025-04-21 14:09:15.519656] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=8, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1549, avg_log_submit_to_slide_time=1574) [2025-04-21 14:09:15.519732] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=976, hit_cnt=8, read_cnt=8, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:15.532906] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:15.532985] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4190, avg_group_log_size=349) [2025-04-21 14:09:15.533033] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:15.534614] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2262, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:15.534676] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4190) [2025-04-21 14:09:15.534736] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=101, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:15.534799] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:15.534842] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2488, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:15.534872] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:15.534911] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4190, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:15.556450] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] get wrs ts(ls_id={id:1}, delta=98763, log_service_ts=1745215755457643, min_tx_service_ts=4611686018427387, timestamp={val:1745215755457643000, v:0}) [2025-04-21 14:09:15.556531] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1001, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=56, Other_Error_Cnt=0, Submit_Succ_Cnt=44, last_scn="{val:1745215754493338001, v:0}", last_lsn={lsn:26293931}, last_gts={val:1745215755493940000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:15.574938] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.581328] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=54] gc stale ls task succ [2025-04-21 14:09:15.587359] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:15.587423] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.587687] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:15.587743] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:15.587769] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:15.587804] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=32] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:15.587832] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254960137921, flush_io_finished_ret_:0, flush_io_finished_round_:147, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:15.598940] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:15.606099] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:15.606159] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:15.607887] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:15.607925] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:15.617617] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=976) [2025-04-21 14:09:15.617687] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=225, avg_log_batch_cnt=1, total_group_log_size=360499, avg_group_log_size=1602) [2025-04-21 14:09:15.617720] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=360499) [2025-04-21 14:09:15.618991] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=976) [2025-04-21 14:09:15.619162] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=225, avg_log_gen_to_freeze_time=810, avg_log_gen_to_submit_time=820, avg_log_submit_to_flush_time=1253, avg_log_submit_to_slide_time=1275) [2025-04-21 14:09:15.619251] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=360499, hit_cnt=230, read_cnt=230, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:15.619345] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7100000, replace_num=100000) [2025-04-21 14:09:15.619396] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:15.642345] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8373) [2025-04-21 14:09:15.642474] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8373) [2025-04-21 14:09:15.642544] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1513, avg_log_submit_to_slide_time=1533) [2025-04-21 14:09:15.642605] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8373, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:15.656610] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDCF-0-0] [lt=34] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:15.658146] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF002C-0-0] [lt=49] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:15.658381] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=66] get number(ret=0, service_type_=0, range=1, base_id=1745215755658307000, start_id=1745215755658307000, end_id=1745215755658307001) [2025-04-21 14:09:15.659978] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1745215755659385000, start_id=1745215755659385000, end_id=1745215755659385001) [2025-04-21 14:09:15.660079] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:15.669440] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=2800000, clean_num=200000) [2025-04-21 14:09:15.674975] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.680524] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDB6-0-0] [lt=14][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.680656] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDC5-0-0] [lt=17][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.682721] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDB8-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.682767] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0241-0-0] [lt=16][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.695129] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.695141] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.695970] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.695979] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.695980] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696033] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696075] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696073] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696095] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=53] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696166] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.696208] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:15.698094] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDB9-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.699981] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDBB-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.709106] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17378955}, readable_log_tail:{lsn:17378955}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49725813, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:15.709252] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=144] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:15.709277] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9155161}, readable_log_tail:{lsn:9155161}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57949607, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:15.709342] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=64] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:15.709378] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=13] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:15.724327] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1745215755723613000, start_id=1745215755723613000, end_id=1745215755723613001) [2025-04-21 14:09:15.724432] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=99] handle gts request statistics(total_rt=533, total_cnt=60, avg_rt=8.737704918032786594e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:15.726934] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFDFF-0-0] [lt=23] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:15.750390] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=20] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:15.750461] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=67] finish to resize log external storage handler(current_ts=1745215755750457, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:15.756757] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] Garbage Collector is running(seq_=15, gc_interval=10000000) [2025-04-21 14:09:15.756838] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=43] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:15.756865] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:15.756895] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=20] gc_check_member_list_ cost time(ret=0, time_us=93) [2025-04-21 14:09:15.756925] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:15.758397] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:15.758415] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDFB-0-0] [lt=65] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:15.758469] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDFC-0-0] [lt=39][errcode=-4006] not init(ret=-4006) [2025-04-21 14:09:15.758512] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:478) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDFC-0-0] [lt=34] finish scan map holding items(scan_cnt=0) [2025-04-21 14:09:15.758620] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDFD-0-0] [lt=19] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:15.759688] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:15.759732] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:15.759762] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=27] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:15.759784] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=54) [2025-04-21 14:09:15.759807] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyHandler start process [2025-04-21 14:09:15.761035] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA3-0-0] [lt=23] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:15.761094] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA3-0-0] [lt=49] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:15.768788] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:15.775120] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:15.775158] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:15.775182] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.792544] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:15.808039] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=54] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:15.815646] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=27] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:15.815704] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=56] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=7) [2025-04-21 14:09:15.815692] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=112] ====== check clog disk timer task ====== [2025-04-21 14:09:15.815723] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=19] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:15.815738] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:15.815741] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=13] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:15.817979] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1745215755817974, bytes: 4987978, bw: 0.013462 MB/s, add_ts: 1007598, add_bytes: 14223 [2025-04-21 14:09:15.819517] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:15.826709] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=63] gc stale ls task succ [2025-04-21 14:09:15.834971] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:15.835040] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:15.835062] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:15.835094] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:15.835115] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254960385202, flush_io_finished_ret_:0, flush_io_finished_round_:147, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:15.835708] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=34] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:15.860035] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:15.863588] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDBD-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.864484] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:09:15.865613] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDBF-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.869930] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:15.871783] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10423, max_lsn:17379199, max_scn:{val:1745215755724678000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17379199}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17379077}, last_submit_end_lsn:{lsn:17379199}, last_submit_log_id:10423, last_submit_log_pid:3, max_flushed_lsn:{lsn:17379077}, max_flushed_end_lsn:{lsn:17379199}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17379199}, last_slide_log_id:10423, last_slide_scn:{val:1745215755724678000, v:0}, last_slide_lsn:{lsn:17379077}, last_slide_end_lsn:{lsn:17379199}, last_slide_log_pid:3, last_slide_log_accum_checksum:532827123, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10424, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17379199}, readable_log_tail:{lsn:17379199}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49725569, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:15.872056] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=263] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215755819230, last_flushed_end_lsn:{lsn:17379199}}]) [2025-04-21 14:09:15.872083] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10424, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215755819230, last_flushed_end_lsn:{lsn:17379199}}]) [2025-04-21 14:09:15.872138] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14575, max_lsn:9155405, max_scn:{val:1745215755724678000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:9155405}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:9155283}, last_submit_end_lsn:{lsn:9155405}, last_submit_log_id:14575, last_submit_log_pid:3, max_flushed_lsn:{lsn:9155283}, max_flushed_end_lsn:{lsn:9155405}, max_flushed_log_pid:3, committed_end_lsn:{lsn:9155405}, last_slide_log_id:14575, last_slide_scn:{val:1745215755724678000, v:0}, last_slide_lsn:{lsn:9155283}, last_slide_end_lsn:{lsn:9155405}, last_slide_log_pid:3, last_slide_log_accum_checksum:4065110649, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14576, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:9155405}, readable_log_tail:{lsn:9155405}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57949363, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:15.872314] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=173] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215755819279, last_flushed_end_lsn:{lsn:9155405}}]) [2025-04-21 14:09:15.872333] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=18] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14576, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215755819279, last_flushed_end_lsn:{lsn:9155405}}]) [2025-04-21 14:09:15.875188] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.885199] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:15.885256] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.893648] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1745215755893643, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:09:15.908982] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE4-0-0] [lt=31] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:15.909445] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDC2-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.910196] WDIAG begin (ob_hashtable.h:954) [624915][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B9CEFDC3-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:15.912859] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=36][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:15.912985] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:15.914658] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=75] ls blacklist refresh finish(cost_time=8654) [2025-04-21 14:09:15.917921] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE63-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:15.918005] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE63-0-0] [lt=80] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:15.919397] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=360499) [2025-04-21 14:09:15.919463] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=360499) [2025-04-21 14:09:15.950491] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE01-0-0] [lt=63] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:15.964016] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=23] current monitor number(seq_=-1) [2025-04-21 14:09:15.964523] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:15.964571] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:15.970103] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:1769) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=39] worker thread began to shrink(id_=1002, token=6) [2025-04-21 14:09:15.970811] INFO [SERVER.OMT] check_worker_count (ob_tenant.cpp:1797) [624915][T1002_L0_G0][T1002][Y0-0000000000000000-0-0] [lt=31] worker thread exit(id_=1002, workers_.get_size()=7) [2025-04-21 14:09:15.970860] INFO [SHARE] end_run (ob_tenant_base.cpp:334) [624915][T1002_L0_G0][T0][Y0-0000000000000000-0-0] [lt=39] tenant thread end_run(id_=1002, ret=0, thread_count_=150) [2025-04-21 14:09:15.971859] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=32] LogLoopThread round_cost_time(us)(round_cost_time=616) [2025-04-21 14:09:15.975272] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:15.980865] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=45] BlockGCTimerTask success(ret=0, cost_time_us=16, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:15.987186] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4079, offset=80199}, end_cursor:ObLogCursor{file_id=3, log_id=4080, offset=80505}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77588050, len:1721, log_data_len:306, seq:4079, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:15.987565] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:15.987650] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215755724678000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215755724678000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:15.990793] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1745215755990413000, start_id=1745215755990413000, end_id=1745215755990413001) [2025-04-21 14:09:15.990918] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:15.993752] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4080, offset=80505}, end_cursor:ObLogCursor{file_id=3, log_id=4081, offset=80802}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7758c050, len:1415, log_data_len:297, seq:4080, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:15.994072] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=40] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:15.994130] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE70-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215755724678001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215755724678001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:16.019659] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:16.039372] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=55] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:16.057311] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:16.057435] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=73] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:16.057475] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=243, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:16.057555] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=27] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:16.057623] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=30] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:16.057645] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=28, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:16.064731] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=104] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:16.070420] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:16.075393] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.087575] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:16.087644] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.132585] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:16.132647] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=55] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:16.132667] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:16.132684] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:16.135834] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=151, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}]) [2025-04-21 14:09:16.136179] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=342] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:16.175526] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.192952] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [619978][T1_TenantWeakRe][T1][YB420B1D7AB6-00063343B1EF003E-0-0] [lt=44] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=2, total_release_part_ctx_count=416) [2025-04-21 14:09:16.193289] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=71] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5517) [2025-04-21 14:09:16.219821] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:16.225053] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:16.239518] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE3-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:16.270958] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:16.275649] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.292970] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0D-0-0] [lt=43] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:16.293050] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0D-0-0] [lt=77] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:16.294014] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0145-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.296324] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0145-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254961846632, cache_obj->added_lc()=false, cache_obj->get_object_id()=722, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:16.340357] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE68-0-0] [lt=19] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:16.340432] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE68-0-0] [lt=72] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:16.364897] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=50][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:16.365980] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=10kB/s, net_out=10kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:16.366052] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:16.366238] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:16.366434] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:16.366522] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:15, schedule:36, submit:9, rt:1519, total:1580) [2025-04-21 14:09:16.366613] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:16.366681] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:15, schedule:36, submit:9, device:1519, total:1580) [2025-04-21 14:09:16.366750] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:16.366824] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:616, total:634) [2025-04-21 14:09:16.366904] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:16.366942] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:616, total:634) [2025-04-21 14:09:16.367004] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:16.367031] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:16.375800] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.385370] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:16.385431] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.407403] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:16.408740] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=142] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:16.408852] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=52] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215751200391000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:16.408939] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:16.408974] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=29] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:16.419979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:16.422366] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:16.427665] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:09:16.435974] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:16.464737] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:16.464822] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.471784] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:16.475401] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.475556] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.475896] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.476142] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.476307] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.547011] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:16.547968] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5725) [2025-04-21 14:09:16.548986] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] get number(ret=0, service_type_=0, range=1, base_id=1745215756547881000, start_id=1745215756547881000, end_id=1745215756547881001) [2025-04-21 14:09:16.549092] INFO [LIB] stat (utility.h:1176) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:16.571324] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:16.571402] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=65] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:16.576203] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=204][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.581418] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=47] gc stale ls task succ [2025-04-21 14:09:16.584863] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=84] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53900, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:16.584926] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=61][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26306722}], scn_array=[cnt:1, {val:1745215756057967000, v:0}], curr_size=587, accum_size=4948, time_cost=526450) [2025-04-21 14:09:16.584953] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=67985, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:16.584992] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:16.584999] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=57674, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:16.585021] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17379443}], scn_array=[cnt:1, {val:1745215755724678003, v:0}], curr_size=122, accum_size=610, time_cost=466882) [2025-04-21 14:09:16.585057] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=56][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65873580}], scn_array=[cnt:1, {val:1745215755992580001, v:0}], curr_size=122, accum_size=3448, time_cost=451542) [2025-04-21 14:09:16.585070] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:16.585084] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3448) [2025-04-21 14:09:16.585071] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:16.585118] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:16.585107] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=67997, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:16.585146] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9155649}], scn_array=[cnt:1, {val:1745215755724678003, v:0}], curr_size=122, accum_size=244, time_cost=466947) [2025-04-21 14:09:16.585142] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=5725, avg_group_log_size=572) [2025-04-21 14:09:16.585133] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=732) [2025-04-21 14:09:16.585181] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=68, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:16.585203] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=16, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:16.585215] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:16.585222] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4811) [2025-04-21 14:09:16.585236] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54064, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:16.585227] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=57][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215756057967000, v:0}, log_ts:{val:1745215756057967000, v:0}, lsn:{lsn:26306778}, submit_ts:1745215756058343}, this:0x7f3c4dda0b00, is_inited_:true, trans_id:{txid:2002212}, ls_id:{id:1}, ctx:0x7f3c4dd9d110, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=526876, ctx_lock_wait_time=3) [2025-04-21 14:09:16.585263] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:16.585272] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=7, avg_log_batch_cnt=1, total_group_log_size=1278, avg_group_log_size=182) [2025-04-21 14:09:16.585265] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=16395, log_task={header:{begin_lsn:{lsn:26306722}, end_lsn:{lsn:26307309}, log_id:16395, min_scn:{val:1745215756057967000, v:0}, max_scn:{val:1745215756057967000, v:0}, data_len:531, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:26306722}, data_checksum:2058668304, accum_checksum:2697513389, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215756058350, freeze_ts:1745215756058355, submit_ts:1745215756058369, flushed_ts:1745215756585025, gen_to_freeze cost time:5, gen_to_submit cost time:19, submit_to_flush cost time:526656}, fs_cb_begin_ts=1745215756585189, log_life_time=526839) [2025-04-21 14:09:16.585305] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=4033, avg_group_log_size=448) [2025-04-21 14:09:16.585333] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:16.585345] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:16.585345] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=83, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:16.585361] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=68172, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:16.585370] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=57826, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:16.585390] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=38962, avg_log_submit_to_slide_time=38989) [2025-04-21 14:09:16.585384] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=6, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=79115, avg_log_submit_to_slide_time=79165) [2025-04-21 14:09:16.585414] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=14810, log_task={header:{begin_lsn:{lsn:65873580}, end_lsn:{lsn:65873702}, log_id:14810, min_scn:{val:1745215755992580001, v:0}, max_scn:{val:1745215755992580001, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:65873580}, data_checksum:667309872, accum_checksum:2389786919, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215756133388, freeze_ts:1745215756133393, submit_ts:1745215756133406, flushed_ts:1745215756585211, gen_to_freeze cost time:5, gen_to_submit cost time:18, submit_to_flush cost time:451805}, fs_cb_begin_ts=1745215756585331, log_life_time=451943) [2025-04-21 14:09:16.585415] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4389] log_task life cost too much time(palf_id=1, self="11.29.122.182:2882", log_id=10426, log_task={header:{begin_lsn:{lsn:17379443}, end_lsn:{lsn:17379565}, log_id:10426, min_scn:{val:1745215755724678003, v:0}, max_scn:{val:1745215755724678003, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:17379443}, data_checksum:667309872, accum_checksum:1296783313, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215756118008, freeze_ts:1745215756118015, submit_ts:1745215756118030, flushed_ts:1745215756585111, gen_to_freeze cost time:7, gen_to_submit cost time:22, submit_to_flush cost time:467081}, fs_cb_begin_ts=1745215756585314, log_life_time=467306) [2025-04-21 14:09:16.585485] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FLUSH CB COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=112, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:16.585482] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT FLUSH CB COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=73, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:16.585502] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=732, hit_cnt=6, read_cnt=6, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:16.585502] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=64] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215755858212000, v:0}, new_max_version={val:1745215755858212000, v:0}, last_min_version={val:1745215755658307001, v:0}, last_max_version={val:1745215755658307001, v:0}, total_time_us=528764, delta_us=727286) [2025-04-21 14:09:16.585539] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3448, hit_cnt=8, read_cnt=8, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:16.585536] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:16.585557] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215755858212000, v:0}, min_version={val:1745215755858212000, v:0}, max_version={val:1745215755858212000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:16.585573] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=68190, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:16.585596] WDIAG [PALF] sliding_cb (log_sliding_window.cpp:2302) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4389] log_task life cost too much time(palf_id=1001, self="11.29.122.182:2882", log_id=14578, log_task={header:{begin_lsn:{lsn:9155649}, end_lsn:{lsn:9155771}, log_id:14578, min_scn:{val:1745215755724678003, v:0}, max_scn:{val:1745215755724678003, v:0}, data_len:66, proposal_id:3, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:9155649}, data_checksum:2222604892, accum_checksum:4274440413, is_padding_log:false, is_raw_write:false}, state_map:{val:62}, ref_cnt:0, gen_ts:1745215756118058, freeze_ts:1745215756118060, submit_ts:1745215756118065, flushed_ts:1745215756585519, gen_to_freeze cost time:2, gen_to_submit cost time:7, submit_to_flush cost time:467454}, fs_cb_begin_ts=1745215756585527, log_life_time=467469) [2025-04-21 14:09:16.585637] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FLUSH CB COST TIME](cur_stat_count=7, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:16.586928] WDIAG [STORAGE.TRANS] on_success (ob_trans_part_ctx.cpp:2253) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF013D-0-0] [lt=56][errcode=-4389] transaction log sync use too much time(log_cb={ObTxBaseLogCb:{base_ts:{val:1745215756193142000, v:0}, log_ts:{val:1745215756193142000, v:0}, lsn:{lsn:65873758}, submit_ts:1745215756193269}, this:0x7f3c6b50c3c0, is_inited_:true, trans_id:{txid:2001230}, ls_id:{id:1}, ctx:0x7f3c6b5089d0, tx_data_guard:{tx_data:NULL}, is_callbacked_:false, is_dynamic_:false, mds_range_:{range_array_.count():0, range_array_:[]}, cb_arg_array_:[{log_type:0x1, arg:null}, {log_type:0x40, arg:null}, {log_type:0x100, arg:null}], first_part_scn_:{val:18446744073709551615, v:3}, extra_cb_:null, need_free_extra_cb_:false, callbacks_.count():1}, log_sync_used_time=393653, ctx_lock_wait_time=2) [2025-04-21 14:09:16.587817] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:16.587872] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.599236] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:16.606104] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:16.606149] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:16.607891] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:16.607927] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:16.618449] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:16.618511] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=6, avg_log_batch_cnt=1, total_group_log_size=732, avg_group_log_size=122) [2025-04-21 14:09:16.618544] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=732) [2025-04-21 14:09:16.618570] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=8, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:16.620136] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:16.620188] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=6, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=79223, avg_log_submit_to_slide_time=79239) [2025-04-21 14:09:16.620267] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=732, hit_cnt=6, read_cnt=6, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:16.620617] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:16.620678] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=49] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:16.620743] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:16.638649] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:16.639890] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=57] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:16.640002] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=48] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215755597265000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:16.672407] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=142] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:16.676317] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.680340] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0147-0-0] [lt=57][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.683014] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0147-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254962233322, cache_obj->added_lc()=false, cache_obj->get_object_id()=723, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:16.684080] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0244-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.684075] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDFB-0-0] [lt=13][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.684468] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] [COMPACTION DAG STATUS] (start_time=1745215746681110, end_time=1745215756684463, dag_status={}) [2025-04-21 14:09:16.684524] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=52] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684546] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684588] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684601] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684613] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684668] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684700] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=32] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:16.684728] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684765] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684788] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684809] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684829] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684849] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684868] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684908] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684928] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684968] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.684988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685040] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=50] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685075] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685106] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685136] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685196] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685219] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685281] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685301] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685321] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685361] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685421] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685441] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685462] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685482] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685521] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685582] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685622] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685643] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685702] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685722] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685742] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685761] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685781] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685820] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685884] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685907] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685947] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.685988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686009] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686109] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686128] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686148] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686169] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686165] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0246-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.686190] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686212] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:16.686275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:16.686295] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:16.686316] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:16.686328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:16.686339] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=11] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:16.686358] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:16.686375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:16.686392] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:16.686410] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:16.686428] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:16.686448] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:16.686674] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014B-0-0] [lt=43][errcode=-4201] hashtable not init [2025-04-21 14:09:16.686735] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014B-0-0] [lt=59] get cursor info failed(cursor_id=45, get_sessid()=3221487630) [2025-04-21 14:09:16.687463] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215756687250000, start_id=1745215756687250000, end_id=1745215756687250001) [2025-04-21 14:09:16.687618] INFO [LIB] stat (utility.h:1176) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:16.687938] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0247-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.688822] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF002F-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:16.689112] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215756193142000, v:0}, base_version={val:1745215755992580000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215756193142000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215756689077, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:16.690052] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=63] [APPLY STAT CB APPEND COST TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=59, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:16.690105] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=52] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=1941, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:16.690136] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=28] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:16.690163] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=26] [APPLY STAT CB EXECUTE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=-489, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:16.690190] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=26] [APPLY STAT CB TOTAL TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=1511, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:16.690798] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=6192) [2025-04-21 14:09:16.690896] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=6192) [2025-04-21 14:09:16.690976] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=34408, avg_log_gen_to_submit_time=34430, avg_log_submit_to_flush_time=53971, avg_log_submit_to_slide_time=54008) [2025-04-21 14:09:16.691060] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=6192, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:16.694533] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.695098] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.695158] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.695840] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696064] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696127] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696174] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696169] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696236] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696240] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.696278] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:16.701028] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0248-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.703118] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F024A-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.708079] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=58] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}) [2025-04-21 14:09:16.718544] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1278) [2025-04-21 14:09:16.720451] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1278) [2025-04-21 14:09:16.725761] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=70] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215756725742], gts:1745215756724775000, latest_srr:[mts=1745215756725742]}) [2025-04-21 14:09:16.733706] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F024C-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.736720] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215756736505000, start_id=1745215756736505000, end_id=1745215756736505001) [2025-04-21 14:09:16.738662] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0250-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.739654] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=73] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:16.776445] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.792661] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:16.811195] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:16.811311] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA4-0-0] [lt=42] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:16.811457] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA4-0-0] [lt=138] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:16.820270] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:16.825603] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215756825598, bytes: 5000750, bw: 0.012088 MB/s, add_ts: 1007624, add_bytes: 12772 [2025-04-21 14:09:16.826787] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:16.835863] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:16.849616] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:16.850564] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:16.850627] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=61] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:16.850707] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=39] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:16.850800] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=89] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:16.850848] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=39] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:16.850876] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215748585280001, v:0}) [2025-04-21 14:09:16.850896] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:16.850915] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:16.850940] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:16.850972] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:16.850996] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:16.851030] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:16.851064] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:16.851085] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:16.866944] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0252-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.869033] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0254-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.872987] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:16.876572] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:16.885530] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:16.885591] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.890630] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=71] get number(ret=0, service_type_=0, range=1, base_id=1745215756890179000, start_id=1745215756890179000, end_id=1745215756890179001) [2025-04-21 14:09:16.901246] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=65] PNIO [ratelimit] time: 1745215756901242, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007599, add_bytes: 0 [2025-04-21 14:09:16.914330] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0257-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.915197] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0258-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:16.919790] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE64-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:16.919857] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE64-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:16.920214] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1353) [2025-04-21 14:09:16.920311] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1353) [2025-04-21 14:09:16.930103] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=42] runTimer to refresh locality_info(ret=0) [2025-04-21 14:09:16.931940] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=30] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:09:16.932004] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=51] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:09:16.932030] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=26] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:09:16.932054] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=20] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:09:16.932070] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:09:16.932089] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=11] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:09:16.932104] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:09:16.932123] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=14] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:09:16.944126] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD93-0-0] [lt=30] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215752026505, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:16.944183] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD93-0-0] [lt=55] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215752028316, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:16.944211] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD93-0-0] [lt=26] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215754965635, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215752029659, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:16.955563] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=58] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:16.964219] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=50] current monitor number(seq_=-1) [2025-04-21 14:09:16.965127] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:16.965222] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=83] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:16.976700] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.000407] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4081, offset=80802}, end_cursor:ObLogCursor{file_id=3, log_id=4082, offset=81108}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77590050, len:1118, log_data_len:306, seq:4081, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:17.000880] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE71-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:17.000977] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE71-0-0] [lt=64] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215756736505001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215756736505001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:17.004722] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE71-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:17.007823] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=93] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4082, offset=81108}, end_cursor:ObLogCursor{file_id=3, log_id=4083, offset=81405}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77594050, len:812, log_data_len:297, seq:4082, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:17.008161] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE71-0-0] [lt=65] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:17.008243] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE71-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215756736505001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215756736505001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:17.020423] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:17.027241] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:17.027293] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=51] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:17.027285] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8D-0-0] [lt=38] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:17.027324] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8D-0-0] [lt=35] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:17.033614] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=55] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:17.039522] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=51] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:17.073528] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:17.076832] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.088064] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:17.088132] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.091436] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=76] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:17.134216] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=34] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:17.134278] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] try gc retain ctx [2025-04-21 14:09:17.134295] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:09:17.134347] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=12] finish update min start scn(max_decided_scn={val:1745215757090707000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215746983493001, v:0}, keep_alive_scn_:{val:1745215751987134001, v:0}, update_ts_:1745215757133523}) [2025-04-21 14:09:17.135341] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215765197259000, latest_log_ts:{val:1745215748585280001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:17.176990] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.187191] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=77] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215757088562000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215757187118}, version_delta=98626) [2025-04-21 14:09:17.189469] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215756890179000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=299276, in_cluster_service=true, cluster_version={val:1745215756890179000, v:0}, min_cluster_version={val:1745215756890179000, v:0}, max_cluster_version={val:1745215756890179000, v:0}, get_cluster_version_err=0, cluster_version_delta=299276, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1364, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=94719592, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:17.220578] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:17.226024] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=49] ts response task statistics(alloc_count=3318, free_count=1658) [2025-04-21 14:09:17.226088] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=51] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=345, get_gts_with_stc_cnt=29, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=28, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:17.226121] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:17.234371] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=103] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3256) [2025-04-21 14:09:17.255157] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCD-0-0] [lt=55] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:17.255204] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCD-0-0] [lt=40] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2025-04-21 14:09:17.274074] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=86] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:17.277141] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=117][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.289552] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=92] no need to update min/max version(new_version={val:1745215756890179000, v:0}, min_version={val:1745215756890179000, v:0}, max_version={val:1745215756890179000, v:0}) [2025-04-21 14:09:17.294559] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0E-0-0] [lt=22] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:17.294610] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0E-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:17.300503] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014D-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.302964] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014D-0-0] [lt=44][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254962853270, cache_obj->added_lc()=false, cache_obj->get_object_id()=724, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:17.308512] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=39][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:17.342207] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE69-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:17.342288] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE69-0-0] [lt=77] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:17.348159] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1745215757347431000, start_id=1745215757347431000, end_id=1745215757347431001) [2025-04-21 14:09:17.368012] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS SERVER] net_in=15kB/s, net_out=15kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:17.368074] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:17.368253] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:17.368445] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:17.368532] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:24, schedule:41, submit:9, rt:1545, total:1620) [2025-04-21 14:09:17.368606] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:17.368665] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:24, schedule:41, submit:9, device:1545, total:1620) [2025-04-21 14:09:17.368733] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:17.368804] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:197083, total:197100) [2025-04-21 14:09:17.368884] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:17.368920] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:197083, total:197100) [2025-04-21 14:09:17.368987] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:17.369030] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:17.377261] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.385709] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:17.385764] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.402750] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:17.420720] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:17.422476] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:09:17.436159] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:17.436846] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:17.436931] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=61] temporary file module use no blocks [2025-04-21 14:09:17.436958] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:17.436989] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:17.437026] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=35] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254961987080, flush_io_finished_ret_:0, flush_io_finished_round_:149, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:17.465374] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:17.465430] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.474609] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:17.475424] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=209] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.475558] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=90] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.475626] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.475663] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=72] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.477388] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.548367] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:09:17.577538] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.581497] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=75] gc stale ls task succ [2025-04-21 14:09:17.588073] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:17.588133] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:17.588158] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:17.588194] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=32] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:17.588215] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=20] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254962138296, flush_io_finished_ret_:0, flush_io_finished_round_:149, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:17.588296] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:17.588361] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.599406] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:17.601895] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:17.601953] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=42] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=30) [2025-04-21 14:09:17.606213] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:17.606258] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:17.608088] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:17.608121] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:17.619221] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:17.619293] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:17.619339] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:17.619391] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:17.619425] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1841, avg_group_log_size=184) [2025-04-21 14:09:17.619460] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1841) [2025-04-21 14:09:17.619488] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:17.620849] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:17.620946] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1520, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:17.621038] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=82] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:17.621063] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1766) [2025-04-21 14:09:17.621130] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:17.621132] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1505, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:17.621158] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=4985, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:17.621162] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=64, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:17.621179] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=3289, avg_log_gen_to_submit_time=3315, avg_log_submit_to_flush_time=1647, avg_log_submit_to_slide_time=1669) [2025-04-21 14:09:17.621212] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:17.621248] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:17.621267] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1649, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:17.621283] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1617, avg_log_submit_to_slide_time=1628) [2025-04-21 14:09:17.621305] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:17.621339] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1766, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:17.621374] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1841, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:17.634666] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=59] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:17.634744] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=3744, avg_group_log_size=312) [2025-04-21 14:09:17.636016] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1341, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:17.636083] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=65] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4329) [2025-04-21 14:09:17.636128] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:17.636168] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4329) [2025-04-21 14:09:17.636235] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:17.636278] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=31633, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:17.636293] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=30156, avg_log_gen_to_submit_time=30176, avg_log_submit_to_flush_time=1432, avg_log_submit_to_slide_time=1457) [2025-04-21 14:09:17.636330] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:17.636373] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4329, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:17.662261] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD0-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:17.675288] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=99] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:17.677706] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=91][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.679862] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014F-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.682151] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF014F-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254963232459, cache_obj->added_lc()=false, cache_obj->get_object_id()=725, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:17.684718] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=98] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=3000000, clean_num=200000) [2025-04-21 14:09:17.687450] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F025A-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.688550] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=42] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017262080, fast_delete_log_mode=false) [2025-04-21 14:09:17.689168] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDFC-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.689480] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:17.689547] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8363, avg_group_log_size=643) [2025-04-21 14:09:17.689654] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDC6-0-0] [lt=61][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.691550] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1752, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:17.691622] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:17.691661] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F025D-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.691683] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:09:17.691759] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:17.691788] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=26485, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:17.691815] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1877, avg_log_submit_to_slide_time=1906) [2025-04-21 14:09:17.691864] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=69, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:17.691881] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7774, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:17.691947] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:17.691989] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215757488553000, v:0}, new_max_version={val:1745215757488553000, v:0}, last_min_version={val:1745215757288668000, v:0}, last_max_version={val:1745215757288668000, v:0}, total_time_us=4468, delta_us=203432) [2025-04-21 14:09:17.692045] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215757488553000, v:0}, min_version={val:1745215757488553000, v:0}, max_version={val:1745215757488553000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:17.694920] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.695408] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.695467] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.695565] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.695619] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.695900] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.696003] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.696069] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.696193] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.696285] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.696326] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:17.704262] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F025E-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.706644] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0260-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.719314] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:17.726572] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215757726555], gts:1745215757726115000, latest_srr:[mts=1745215757726555]}) [2025-04-21 14:09:17.729095] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:17.737502] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9157734}], scn_array=[cnt:1, {val:1745215757225439004, v:0}], curr_size=122, accum_size=976, time_cost=18005) [2025-04-21 14:09:17.737609] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17381331}], scn_array=[cnt:1, {val:1745215757225439004, v:0}], curr_size=122, accum_size=1220, time_cost=18265) [2025-04-21 14:09:17.737679] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=69] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:17.751336] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8363) [2025-04-21 14:09:17.765906] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=20] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:17.767119] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:17.767215] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215748781280000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:17.777828] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.792798] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:17.815880] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:09:17.815945] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=56] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:17.826874] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:17.829028] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7200000, replace_num=100000) [2025-04-21 14:09:17.829092] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:17.833217] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215757833212, bytes: 5014973, bw: 0.013462 MB/s, add_ts: 1007614, add_bytes: 14223 [2025-04-21 14:09:17.835342] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=49] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:17.835429] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=76] temporary file module use no blocks [2025-04-21 14:09:17.835455] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:17.835483] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:17.835512] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254962385569, flush_io_finished_ret_:0, flush_io_finished_round_:149, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:17.836043] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:17.840090] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=59] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:17.866170] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:17.870469] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0262-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.872421] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0264-0-0] [lt=55][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.877950] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:17.885252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:17.885896] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:17.885975] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=69] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.889342] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0035-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012281227111816406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.817012940011868523e+02) [2025-04-21 14:09:17.908893] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215757908887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007645, add_bytes: 0 [2025-04-21 14:09:17.909202] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=24) [2025-04-21 14:09:17.919340] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0267-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.920077] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0268-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:17.921318] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=104] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:17.921395] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:17.921921] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE65-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:17.921990] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE65-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:17.925451] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=41] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:17.964361] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=43] current monitor number(seq_=-1) [2025-04-21 14:09:17.965553] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:17.965615] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:17.978084] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.015048] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4083, offset=81405}, end_cursor:ObLogCursor{file_id=3, log_id=4084, offset=81711}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77598050, len:515, log_data_len:306, seq:4083, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:18.015430] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE72-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:18.015513] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE72-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215757726115001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215757726115001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:18.019092] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE72-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:18.022531] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=88] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4084, offset=81711}, end_cursor:ObLogCursor{file_id=3, log_id=4085, offset=82008}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7759c050, len:4305, log_data_len:297, seq:4084, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:18.022893] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE72-0-0] [lt=64] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:18.022954] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE72-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215757726115001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215757726115001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:18.029227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:18.039656] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=44] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:18.049394] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFE12-0-0] [lt=90] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:09:18.074228] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:18.078232] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.085778] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:18.088550] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:18.088630] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=71] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.178356] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=91][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.227134] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=88] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215758227088], gts:1745215758226784000, latest_srr:[mts=1745215758227088]}) [2025-04-21 14:09:18.227229] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=91] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:18.229377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:18.235210] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3072) [2025-04-21 14:09:18.278488] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.286312] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:18.292412] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=141] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26325250, this={dio_aligned_buf:{buf_write_offset:847, buf_padding_size:3249, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:6497, truncate_used_ts:2673}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26324992, buf_len=589, total_write_size=81916, total_write_size_after_dio=712704, ob_pwrite_used_ts=758451, count=154, each_pwrite_cost=4925) [2025-04-21 14:09:18.293257] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:18.296853] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0F-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:18.296928] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE0F-0-0] [lt=70] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:18.308354] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0151-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.311737] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0151-0-0] [lt=56][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254963862042, cache_obj->added_lc()=false, cache_obj->get_object_id()=726, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:18.344072] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6A-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:18.344149] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6A-0-0] [lt=73] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.348581] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0041-0-0] [lt=60] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215758348260, can_tenant_elr:true}) [2025-04-21 14:09:18.370136] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:18.370207] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:18.370393] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:18.370576] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:18.370660] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12261, [delay/us]:prepare:21, schedule:44, submit:9, rt:1693, total:1768) [2025-04-21 14:09:18.370754] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:18.370826] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12261, [delay/us]: prepare:21, schedule:44, submit:9, device:1693, total:1768) [2025-04-21 14:09:18.370890] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:18.370965] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:684, total:700) [2025-04-21 14:09:18.371044] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:18.371082] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:684, total:700) [2025-04-21 14:09:18.371143] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:18.371171] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:18.378606] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=77][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.386041] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:18.386096] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.409121] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:18.409176] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:18.422561] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=79] gc stale ls task succ [2025-04-21 14:09:18.429523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:18.429598] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:09:18.436333] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:18.437154] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:18.437209] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:18.437227] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:18.437258] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:18.437278] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254962987390, flush_io_finished_ret_:0, flush_io_finished_round_:150, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:18.465769] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:18.465845] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.475025] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.475502] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.475566] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.475698] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.478772] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.486850] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:18.549301] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:09:18.557523] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620317][T1002_Compactio][T1002][YB420B1D7AB6-00063343B84EFD8A-0-0] [lt=29] InfoPoolResizeTask(cost_ts=13) [2025-04-21 14:09:18.558100] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=99] clear dtl interm result cost(us)(clear_cost=392, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:18.567876] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=25] ====== traversal_flush timer task ====== [2025-04-21 14:09:18.568000] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA3-0-0] [lt=41] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215758226784002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:18.568160] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA3-0-0] [lt=122] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:18.568229] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA3-0-0] [lt=66] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:18.571551] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:09:18.571598] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:18.578892] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.581571] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:18.588393] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=54] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:18.588491] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=85] temporary file module use no blocks [2025-04-21 14:09:18.588511] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:18.588548] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:18.588570] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=20] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254963138587, flush_io_finished_ret_:0, flush_io_finished_round_:150, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:18.588754] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:18.588810] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.599568] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:18.606217] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:18.606256] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:18.608630] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:18.608669] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:18.619954] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:18.620011] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:18.620045] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:18.620080] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:18.620106] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:18.620127] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:18.620152] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:18.621624] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3398, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:18.621680] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:18.621705] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3206, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:18.621764] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:18.621742] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:18.621810] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:18.621837] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3545, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:18.621856] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=3497, avg_log_submit_to_slide_time=3516) [2025-04-21 14:09:18.621887] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:18.621927] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:18.621947] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3351, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:18.621964] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=3323, avg_log_submit_to_slide_time=3341) [2025-04-21 14:09:18.621986] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:18.622020] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:18.622057] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:18.622700] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] ====== tenant freeze timer task ====== [2025-04-21 14:09:18.622744] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=34] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:18.622782] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:18.629648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:18.635500] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:18.635552] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:18.636935] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1325, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:18.637015] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:18.637055] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:18.637089] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:18.637153] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:18.637182] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1461, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:18.637203] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1412, avg_log_submit_to_slide_time=1438) [2025-04-21 14:09:18.637239] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=64, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:18.637279] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:18.663029] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:09:18.664076] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=48] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:18.664146] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=69] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:18.664223] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:18.664337] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=108] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:18.664372] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:18.664401] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215754222578001, v:0}) [2025-04-21 14:09:18.664423] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:18.664451] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:18.664485] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:18.664509] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:18.664544] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:18.664580] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:18.665593] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:18.665634] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:18.665684] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:18.665755] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:18.665771] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:18.665793] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:18.665818] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:18.665841] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:18.665865] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:18.665892] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:18.665911] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:18.678961] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.679482] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE66-0-0] [lt=28] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.682322] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=38] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745300457074037, last_date_:0, this_date_:0, next_date_:1745300457074037, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:18.682443] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=120] check all tenants(ret=0) [2025-04-21 14:09:18.683774] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE69-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.685090] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6A-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.686390] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6B-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.687551] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:18.687703] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6C-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.688987] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6D-0-0] [lt=31] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.690295] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6E-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.691268] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:18.691351] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F026A-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.691359] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7771, avg_group_log_size=647) [2025-04-21 14:09:18.692875] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:18.692932] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] submit log success(service_type_=0, last_id=1745215775197259000, limited_id=1745215775197259000) [2025-04-21 14:09:18.692933] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F026B-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.692958] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] submit log with lock success(service_type_=0, last_id=1745215775197259000, limited_id=1745215775197259000) [2025-04-21 14:09:18.693625] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=123] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1768, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:18.693671] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE6F-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.693700] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:18.693863] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7771) [2025-04-21 14:09:18.694015] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=19, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:18.694050] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1993, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:18.694072] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1922, avg_log_submit_to_slide_time=1962) [2025-04-21 14:09:18.694120] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=86, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:18.694148] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7771, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:18.694250] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215758489057000, v:0}, new_max_version={val:1745215758489057000, v:0}, last_min_version={val:1745215758289177000, v:0}, last_max_version={val:1745215758289177000, v:0}, total_time_us=5875, delta_us=205187) [2025-04-21 14:09:18.694325] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=69] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215758489057000, v:0}, min_version={val:1745215758489057000, v:0}, max_version={val:1745215758489057000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:18.694876] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F026E-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.695089] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F026F-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.695264] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.695432] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.695480] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.695606] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=26] update id meta(ret=0, service_type=0, limited_id=1745215775197259000, latest_scn={val:1745215758691981001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:18.695712] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=104] handle submit callback(service_type_=0, success=true, used_ts=2782, log_ts={val:1745215758691981001, v:0}, limited_id=1745215775197259000) [2025-04-21 14:09:18.695761] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=46] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:18.695784] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=22] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:18.695919] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.695995] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696018] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696038] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696096] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696280] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696385] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696458] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:18.696825] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF014C-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1745215758696451000, start_id=1745215758696451000, end_id=1745215758696451001) [2025-04-21 14:09:18.700195] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:18.700229] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:18.700289] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=41][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:18.700325] WDIAG read_multi_row (ob_table_access_helper.h:238) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:18.702204] INFO delete_row (ob_table_access_helper.h:312) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215758700353) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215758700353) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:18.703210] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=50] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:18.708475] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0270-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.710635] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=39] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:18.711281] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0272-0-0] [lt=75][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.715575] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=62] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:18.720077] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:18.729676] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE01-0-0] [lt=58] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:18.750337] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=81] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:18.760908] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFDFF-0-0] [lt=22] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:18.763686] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA5-0-0] [lt=55] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:18.779108] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:18.779149] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=30] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:18.779169] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.792968] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=68] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:18.794238] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8585) [2025-04-21 14:09:18.820064] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:18.820136] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=69] try gc retain ctx [2025-04-21 14:09:18.820152] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:18.820209] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] finish update min start scn(max_decided_scn={val:1745215758226784004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215748715893000, v:0}, keep_alive_scn_:{val:1745215753721686000, v:0}, update_ts_:1745215758819311}) [2025-04-21 14:09:18.821194] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:18.821409] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=105] finish update min start scn(max_decided_scn={val:1745215758226784004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215748715893000, v:0}, keep_alive_scn_:{val:1745215753721686000, v:0}, update_ts_:1745215758820376}) [2025-04-21 14:09:18.822478] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=114] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215755724678001, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:18.823433] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:09:18.826958] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:09:18.829773] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:18.835642] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:18.835736] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=84] temporary file module use no blocks [2025-04-21 14:09:18.835756] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:18.835785] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:18.835811] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254963385875, flush_io_finished_ret_:0, flush_io_finished_round_:150, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:18.836239] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:18.840848] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215758840842, bytes: 5027745, bw: 0.012088 MB/s, add_ts: 1007630, add_bytes: 12772 [2025-04-21 14:09:18.868807] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=39] ObArchiveSender is running(thread_index=1) [2025-04-21 14:09:18.873939] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0274-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.876070] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0276-0-0] [lt=63][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.879096] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:18.886226] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:18.886301] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.888161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:18.908895] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE6-0-0] [lt=48] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:18.914271] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=52] start to print blacklist info [2025-04-21 14:09:18.914443] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] ls blacklist refresh finish(cost_time=8317) [2025-04-21 14:09:18.916487] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1745215758916483, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007596, add_bytes: 0 [2025-04-21 14:09:18.921881] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=73] [APPLY STAT CB APPEND COST TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=66, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:18.921943] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=60] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1668, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:18.921960] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:18.921980] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=19] [APPLY STAT CB EXECUTE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=-540, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:18.921999] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=1194, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:18.921985] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:18.922057] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:18.923832] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE70-0-0] [lt=47] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:18.923895] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE70-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:18.924640] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0279-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.925467] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F027A-0-0] [lt=54][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:18.933703] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=65] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:18.935020] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620120][T1001_ReqMemEvi][T1001][YB420B1D7AB6-00063343AEBEFDA4-0-0] [lt=42] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.988281822204589844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.898793992139417242e+02) [2025-04-21 14:09:18.935247] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] get number(ret=0, service_type_=0, range=1, base_id=1745215758934950000, start_id=1745215758934950000, end_id=1745215758934950001) [2025-04-21 14:09:18.952778] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE03-0-0] [lt=59] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:18.964521] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=51] current monitor number(seq_=-1) [2025-04-21 14:09:18.965954] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:18.966006] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:18.979182] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.023705] INFO [SHARE] run1 (ob_dynamic_thread_pool.cpp:594) [619612][qth_mgr][T0][Y0-0000000000000000-0-0] [lt=69] [thread pool stat](pool_stat={pool:0x7f3c901e9480, last_check_time:1745215759023699, last_idle_time:160709759, last_thread_count:1}, *pool={name:IO_SYNC_CH, this:0x7f3c901e9480, min_thread_cnt:1, max_thread_cnt:96, running_thread_cnt:0, threads_idle_time:160709759, tenant_id:500}, qsize=-1, current_idle_time=160709759) [2025-04-21 14:09:19.028018] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:19.028067] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=48] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:19.028066] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8E-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:19.028119] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8E-0-0] [lt=48] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:19.029909] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:19.030233] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=66] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4085, offset=82008}, end_cursor:ObLogCursor{file_id=3, log_id=4086, offset=82314}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775a0050, len:4008, log_data_len:306, seq:4085, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:19.030569] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE73-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:19.030640] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE73-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215758727742002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215758727742002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:19.034242] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE73-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:19.037022] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4086, offset=82314}, end_cursor:ObLogCursor{file_id=3, log_id=4087, offset=82611}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775a4050, len:3702, log_data_len:297, seq:4086, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:19.037303] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE73-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:19.037357] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE73-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215758727742001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215758727742001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:19.039818] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=71] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:19.047632] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=55] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215758727742000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=319877, in_cluster_service=true, cluster_version={val:1745215758226784004, v:0}, min_cluster_version={val:1745215758226784004, v:0}, max_cluster_version={val:1745215758226784004, v:0}, get_cluster_version_err=0, cluster_version_delta=820835, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1349, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=89923355, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:19.057837] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:19.057969] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=80] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:19.058004] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=248, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:19.058082] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:19.058158] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:19.058185] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=28, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:19.075733] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=67] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:140854994, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:101, recv_lp_rpc_cnt:0, recv_mysql_cnt:1266, recv_task_cnt:123, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:467408, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:71, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:142, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:582, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=1, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:09:19.076457] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=721] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:09:19.076496] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=38] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:10541110, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:790434, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:09:19.077132] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=635] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:09:19.077149] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=16] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:8817198, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:395182, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:09:19.077776] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=625] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:09:19.077797] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=21] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:43524962, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:135, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:61254, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:570, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:09:19.078587] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=787] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:09:19.078573] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=34] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000) [2025-04-21 14:09:19.078627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=53] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.078724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.078816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.078917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079249] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.079292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.078611] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=23] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:72126729, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:1712, recv_task_cnt:54, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:62139, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:271, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215741776438}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:1118, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=20, token_change_ts:1745215755970093, tenant_role:1}) [2025-04-21 14:09:19.079347] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=735] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:09:19.079362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.079960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.080999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=45] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.081940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082208] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.082986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083597] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.083939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.084955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085568] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.085972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.086988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.087989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088074] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:19.088122] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:19.088124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088148] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=24] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:19.088171] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:19.088192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:19.088737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.088948] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:19.088999] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.089022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089908] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.089977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090044] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090111] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090386] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090859] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:19.090888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.090903] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:19.090950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091442] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091334] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=17] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:19.091680] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=342] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:19.091683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091730] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] update_check_range(min_check_version=14, max_check_version=15, global_version=16) [2025-04-21 14:09:19.091744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.091984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.092985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093247] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.093969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094186] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1745215758892240000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65883693}, palf_committed_end_scn_:{val:1745215759092340000, v:0}, last_check_scn_:{val:1745215759092340000, v:0}, max_applied_cb_scn_:{val:1745215758892240000, v:0}}) [2025-04-21 14:09:19.094226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094238] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65883693}, readable_log_tail:{lsn:65883693}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1221075, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:19.094347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094644] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.094957] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.095971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096171] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.096989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.097951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098577] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.098990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099395] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099596] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099729] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099799] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.099938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.100955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101317] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.101999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.102969] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103376] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.103985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104786] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.104986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105279] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.105954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106487] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106698] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.106972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107313] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.107988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.108939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.109956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110799] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.110935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.111964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.112986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.113954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.114975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115307] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.115984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.116989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.117952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118406] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 232 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 88 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 21 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 97 245 0 1002 2 33 1 0 1002 4 1 1 0 1002 5 21 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 26727 [2025-04-21 14:09:19.118429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118478] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=39] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,079,066,624 rpc_hold: 0 cache_hold: 134,217,728 cache_used: 134,217,728 cache_item_count: 64 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:19.118495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118563] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118813] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,451,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,792,320 used= 4,210,688 count= 71 avg_used= 59,305 block_cnt= 71 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,218,112 used= 3,084,912 count= 666 avg_used= 4,632 block_cnt= 666 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,603,840 used= 1,517,936 count= 42 avg_used= 36,141 block_cnt= 42 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 6 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 609,600 used= 595,200 count= 75 avg_used= 7,936 block_cnt= 75 chunk_cnt= 14 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 383,616 used= 368,064 count= 81 avg_used= 4,544 block_cnt= 81 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 227,584 used= 222,208 count= 28 avg_used= 7,936 block_cnt= 28 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 10,112 used= 7,395 count= 14 avg_used= 528 block_cnt= 13 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,768 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,451,072 used= 376,298,039 count= 32,202 avg_used= 11,685 mod=SUMMARY [2025-04-21 14:09:19.118848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118867] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=37] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:09:19.118901] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:09:19.118918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.118933] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 88,452,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 83,453,440 used= 75,789,527 count= 3,772 avg_used= 20,092 block_cnt= 3,772 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,550,144 used= 3,337,968 count= 367 avg_used= 9,095 block_cnt= 367 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,447,040 used= 1,319,360 count= 665 avg_used= 1,984 block_cnt= 222 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 88,452,608 used= 80,448,455 count= 4,806 avg_used= 16,739 mod=SUMMARY [2025-04-21 14:09:19.118965] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:09:19.118992] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:09:19.118988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119029] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 134,217,728 used= 134,217,728 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 mod=SUMMARY [2025-04-21 14:09:19.119056] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:09:19.119057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119082] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:19.119108] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:19.119125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119133] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:09:19.119171] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,732,032 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,861,312 used= 1,817,344 count= 229 avg_used= 7,936 block_cnt= 229 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,732,032 used= 19,659,072 count= 233 avg_used= 84,373 mod=SUMMARY [2025-04-21 14:09:19.119196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119202] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:09:19.119241] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:09:19.119265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119276] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:19.119335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8A-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213951200391000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213941191562000, max_merged_snapshot=1) [2025-04-21 14:09:19.119561] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,343,680 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_logical_del_time()=254964868292, cache_obj->added_lc()=false, cache_obj->get_object_id()=727, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:19.345598] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6B-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:19.345661] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6B-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:19.351801] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=71] get_max_applied_scn(scn={val:1745215758727742005, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17383396}, palf_committed_end_scn_:{val:1745215759228137000, v:0}, last_check_scn_:{val:1745215759228137000, v:0}, max_applied_cb_scn_:{val:1745215758727742005, v:0}}) [2025-04-21 14:09:19.351895] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=80] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17383396}, readable_log_tail:{lsn:17383396}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49721372, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:19.372254] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:19.372319] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:19.372502] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:19.372695] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:19.372780] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:15, schedule:36, submit:9, rt:1224, total:1284) [2025-04-21 14:09:19.372857] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:19.372919] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:15, schedule:36, submit:9, device:1224, total:1284) [2025-04-21 14:09:19.372981] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:19.373068] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:617, total:632) [2025-04-21 14:09:19.373153] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:19.373191] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:617, total:632) [2025-04-21 14:09:19.373249] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:19.373273] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:19.379476] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.386402] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:19.386454] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.400894] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=30] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:19.400948] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=41] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:19.400970] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=31) [2025-04-21 14:09:19.401781] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:19.401944] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA4-0-0] [lt=61] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215759348843000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:19.402091] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA4-0-0] [lt=139] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:19.413756] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:19.414283] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:19.415507] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=36] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:19.415600] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215751200391000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:19.422663] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:19.430208] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:19.436502] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:19.437400] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:19.437448] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] temporary file module use no blocks [2025-04-21 14:09:19.437468] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:19.437495] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:19.437517] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254963987638, flush_io_finished_ret_:0, flush_io_finished_round_:151, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:19.444828] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:19.445814] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:19.445876] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=61] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:19.445955] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:19.446063] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=103] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:19.446110] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:19.446137] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215751290420001, v:0}) [2025-04-21 14:09:19.446156] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:19.446173] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:19.446195] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:19.446226] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:19.446249] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:19.446280] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:19.446314] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:19.446334] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:19.448039] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=151] get_max_applied_scn(scn={val:1745215759228137001, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9159921}, palf_committed_end_scn_:{val:1745215759228137002, v:0}, last_check_scn_:{val:1745215759228137002, v:0}, max_applied_cb_scn_:{val:1745215759228137001, v:0}}) [2025-04-21 14:09:19.448099] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=54] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9159921}, readable_log_tail:{lsn:9159921}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57944847, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:19.466168] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:19.466237] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.475312] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.475593] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.475656] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.475787] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.479570] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.489734] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:19.493019] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=99] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:19.538880] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=53] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:19.550106] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=107] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9648) [2025-04-21 14:09:19.551284] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=60] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:19.579638] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.581660] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:19.589186] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:19.589263] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.599861] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:19.608118] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:19.608170] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:19.610162] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:19.610200] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:19.620710] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=71] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:19.620787] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:19.620838] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:19.620879] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:19.620909] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:19.620933] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:19.620972] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:19.622909] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1863, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:19.622994] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:19.623092] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:19.623240] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=99] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:19.623282] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2023, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:19.623314] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=34, avg_log_submit_to_flush_time=1956, avg_log_submit_to_slide_time=1989) [2025-04-21 14:09:19.623366] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=68, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:19.623425] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:19.623503] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1851, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:19.623553] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:19.623644] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:19.623684] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1966, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:19.623722] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=10, avg_log_submit_to_flush_time=1940, avg_log_submit_to_slide_time=1956) [2025-04-21 14:09:19.623773] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:19.623830] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:19.630360] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:19.636274] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:19.636330] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3663, avg_group_log_size=333) [2025-04-21 14:09:19.637720] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1395, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:19.637766] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3663) [2025-04-21 14:09:19.637807] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:19.637850] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3663) [2025-04-21 14:09:19.637911] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:19.637930] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1763, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:19.637946] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=231, avg_log_gen_to_submit_time=249, avg_log_submit_to_flush_time=1489, avg_log_submit_to_slide_time=1514) [2025-04-21 14:09:19.637979] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:19.638013] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3663, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:19.643863] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=49] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:19.643913] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=48] try gc retain ctx [2025-04-21 14:09:19.643944] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=30] try to retry start_working [2025-04-21 14:09:19.644002] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215759549521000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215749489253001, v:0}, keep_alive_scn_:{val:1745215754493338001, v:0}, update_ts_:1745215759643590}) [2025-04-21 14:09:19.645051] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215767945792000, latest_log_ts:{val:1745215751290420001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:19.645919] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=50] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:19.647347] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=52] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:19.647471] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215755597265000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:19.654812] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=55] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:19.654870] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=29) [2025-04-21 14:09:19.655349] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=29] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:19.655420] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=55] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:19.655451] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:19.655471] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=29) [2025-04-21 14:09:19.667888] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD1-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:19.679727] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.690017] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=29] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:19.690092] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=54] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=31) [2025-04-21 14:09:19.690290] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:19.691029] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1745215759690557000, start_id=1745215759690557000, end_id=1745215759690557001) [2025-04-21 14:09:19.693379] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:19.693435] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:19.693423] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=91] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:19.693465] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=26] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=31) [2025-04-21 14:09:19.694679] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.694775] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.695214] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=81] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.695994] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696071] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696131] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696148] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=20] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696176] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696243] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F027C-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.696366] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696386] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFDFD-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.696470] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.696556] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:19.698218] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F027F-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.699364] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0280-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.699647] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=3200000, clean_num=200000) [2025-04-21 14:09:19.712277] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0281-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.714241] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0283-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.720974] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:19.729173] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1745215759728613000, start_id=1745215759728613000, end_id=1745215759728613001) [2025-04-21 14:09:19.729285] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=78] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=398, get_gts_with_stc_cnt=59, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=58, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:19.729654] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215759729628], gts:1745215759728613000, latest_srr:[mts=1745215759729628]}) [2025-04-21 14:09:19.749892] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:19.749947] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=17, avg_log_batch_cnt=1, total_group_log_size=10351, avg_group_log_size=608) [2025-04-21 14:09:19.751991] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT WRITE LOG COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1560, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:19.752088] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:19.752124] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=10351) [2025-04-21 14:09:19.752198] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:19.752224] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=1700, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:19.752245] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=17, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1653, avg_log_submit_to_slide_time=1676) [2025-04-21 14:09:19.752292] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FLUSH CB COST TIME](cur_stat_count=17, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:19.752467] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=67] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=10351, hit_cnt=17, read_cnt=17, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:19.752539] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215759228137002, v:0}, new_max_version={val:1745215759228137002, v:0}, last_min_version={val:1745215759228137000, v:0}, last_max_version={val:1745215759228137000, v:0}, total_time_us=4286, delta_us=524397) [2025-04-21 14:09:19.752582] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215759228137002, v:0}, min_version={val:1745215759228137002, v:0}, max_version={val:1745215759228137002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:19.767864] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=108] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:19.779816] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.793158] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=93] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:19.810423] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=36][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:19.811188] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE25-0-0] [lt=41] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:19.811687] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE25-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215759811663, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:19.811728] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE25-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215759810491}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215759811663, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:19.816083] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:19.816149] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=55] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:19.822436] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=19, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:19.822487] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=50] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=3081, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:19.822507] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=18] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:19.822524] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=16] [APPLY STAT CB EXECUTE TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=-525, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:19.822542] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F024F-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=33, stat_interval=5000000, avg (count/cost)=2575, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:19.827037] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:19.830522] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:19.836405] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:19.848471] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215759848466, bytes: 5042461, bw: 0.013928 MB/s, add_ts: 1007624, add_bytes: 14716 [2025-04-21 14:09:19.867881] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=50] ====== tenant freeze timer task ====== [2025-04-21 14:09:19.869813] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65885936}, readable_log_tail:{lsn:65885936}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1218832, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:19.869965] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=151] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:09:19.870012] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=21] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:19.877375] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0285-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.879318] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0287-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.879884] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.880495] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] Garbage Collector is running(seq_=16, gc_interval=10000000) [2025-04-21 14:09:19.880580] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=45] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:19.880621] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=28] gc_check_member_list_ cost time(ret=0, time_us=80) [2025-04-21 14:09:19.880645] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=16] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:19.880672] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:19.880706] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=28] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:19.880730] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=27) [2025-04-21 14:09:19.880745] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2025-04-21 14:09:19.886570] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:19.886627] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.892610] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9537) [2025-04-21 14:09:19.896217] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=47] finish to resize log external storage handler(current_ts=1745215759896210, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:19.900123] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:19.918412] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=44] blacklist_loop exec finished(cost_time=27, is_enabled=true, send_cnt=0) [2025-04-21 14:09:19.922394] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:19.922467] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:19.922497] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:19.922600] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:19.922644] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=39] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:19.922665] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:19.922698] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:19.924098] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215759924094, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007611, add_bytes: 0 [2025-04-21 14:09:19.925677] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE72-0-0] [lt=22] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:19.925739] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE72-0-0] [lt=59] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:19.926043] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:19.926776] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=730] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:19.929202] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F028A-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.929984] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F028B-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:19.964665] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=42] current monitor number(seq_=-1) [2025-04-21 14:09:19.966366] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:19.966418] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:19.968158] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFE12-0-0] [lt=56][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:09:19.979958] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:19.985244] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=44] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14847, max_lsn:65886521, max_scn:{val:1745215759892909000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65886521}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65885936}, last_submit_end_lsn:{lsn:65886521}, last_submit_log_id:14847, last_submit_log_pid:3, max_flushed_lsn:{lsn:65885936}, max_flushed_end_lsn:{lsn:65886521}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65886521}, last_slide_log_id:14847, last_slide_scn:{val:1745215759892909000, v:0}, last_slide_lsn:{lsn:65885936}, last_slide_end_lsn:{lsn:65886521}, last_slide_log_pid:3, last_slide_log_accum_checksum:3697211789, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14848, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65886521}, readable_log_tail:{lsn:65886521}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1218247, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:09:19.985507] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=253] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215759894629, last_flushed_end_lsn:{lsn:65886521}}]) [2025-04-21 14:09:19.985540] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=29] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14848, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215759894629, last_flushed_end_lsn:{lsn:65886521}}]) [2025-04-21 14:09:20.000828] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:20.035551] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7300000, replace_num=100000) [2025-04-21 14:09:20.035604] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:20.039955] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:20.043175] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4087, offset=82611}, end_cursor:ObLogCursor{file_id=3, log_id=4088, offset=82917}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775a8050, len:3405, log_data_len:306, seq:4087, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:20.043524] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:20.043600] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215759728613001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215759728613001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:20.045676] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=39] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.988433218002319336e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.898274259352044737e+02) [2025-04-21 14:09:20.047204] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=56] get number(ret=0, service_type_=0, range=1, base_id=1745215760046953000, start_id=1745215760046953000, end_id=1745215760046953001) [2025-04-21 14:09:20.047328] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:20.049934] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=64] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4088, offset=82917}, end_cursor:ObLogCursor{file_id=3, log_id=4089, offset=83214}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775ac050, len:3099, log_data_len:297, seq:4088, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:20.050167] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:20.050215] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE74-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215759728613002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215759728613002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:20.080026] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.082519] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=104] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:20.085329] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=42] LogLoopThread round_cost_time(us)(round_cost_time=370) [2025-04-21 14:09:20.089425] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:20.089493] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.100651] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:20.111051] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=53] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:20.141188] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=54] BlockGCTimerTask success(ret=0, cost_time_us=10, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:20.180099] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.229943] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=47] ts response task statistics(alloc_count=3390, free_count=1694) [2025-04-21 14:09:20.230020] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=66] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:20.235707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:20.236776] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:20.280186] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.289663] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215760090866000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198781, in_cluster_service=true, cluster_version={val:1745215759890775000, v:0}, min_cluster_version={val:1745215759890775000, v:0}, max_cluster_version={val:1745215759890775000, v:0}, get_cluster_version_err=0, cluster_version_delta=398872, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1361, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=95110240, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:20.300263] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE11-0-0] [lt=23] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:20.300316] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE11-0-0] [lt=51] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:20.301264] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:20.321188] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0154-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.323688] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0154-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254965873996, cache_obj->added_lc()=false, cache_obj->get_object_id()=728, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:20.347419] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6C-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:20.347497] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6C-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:20.374342] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:20.374407] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:20.374587] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:20.374783] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:20.374866] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:15, schedule:41, submit:10, rt:1180, total:1246) [2025-04-21 14:09:20.374944] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:20.375009] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:15, schedule:41, submit:10, device:1180, total:1246) [2025-04-21 14:09:20.375064] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:20.375137] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:706, total:724) [2025-04-21 14:09:20.375213] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:20.375249] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:706, total:724) [2025-04-21 14:09:20.375308] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:20.375333] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:20.378123] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=57][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26339279}], scn_array=[cnt:1, {val:1745215760350043000, v:0}], curr_size=589, accum_size=4830, time_cost=27776) [2025-04-21 14:09:20.380267] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.386744] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:20.386799] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.391034] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:20.392955] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=67] get number(ret=0, service_type_=0, range=1, base_id=1745215760392889000, start_id=1745215760392889000, end_id=1745215760392889001) [2025-04-21 14:09:20.409331] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=41] ====== check clog disk timer task ====== [2025-04-21 14:09:20.409389] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:20.422745] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:09:20.431674] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] ====== tenant freeze timer task ====== [2025-04-21 14:09:20.435854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=68] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:20.436684] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:20.466578] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:20.466652] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.475303] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.475692] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.475756] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=27] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.475895] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.480343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.501812] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:20.550922] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7888) [2025-04-21 14:09:20.571735] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:20.571787] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:20.580412] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.581737] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:09:20.588796] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:20.588853] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:20.588877] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:20.588906] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:20.588931] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254965139035, flush_io_finished_ret_:0, flush_io_finished_round_:152, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:20.589619] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:20.589671] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.600066] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:20.606534] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:20.606586] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:20.608436] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:20.608473] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:20.621536] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=89] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:20.621627] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:20.621687] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:20.621748] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:20.621796] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:20.621834] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:20.621875] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:20.623634] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1719, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:20.623689] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:20.623730] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:20.623803] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:20.623831] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1867, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:20.623871] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:20.623947] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1666, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:20.623983] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:20.624044] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:20.624067] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1784, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:20.624099] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:20.624132] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:20.624792] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:20.624838] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:20.624880] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:20.636007] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:20.637078] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:20.637136] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3956, avg_group_log_size=395) [2025-04-21 14:09:20.638428] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1354, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:20.638497] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3956) [2025-04-21 14:09:20.638555] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:20.638582] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3956) [2025-04-21 14:09:20.638642] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:20.638672] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1501, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:20.638711] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1452, avg_log_submit_to_slide_time=1478) [2025-04-21 14:09:20.638752] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:20.638792] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3956, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:20.680502] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.693640] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0156-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.693985] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=85] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:20.694877] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:20.695157] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695230] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695297] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695358] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695417] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695459] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695788] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=74] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695862] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.695916] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.696240] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.696267] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0156-0-0] [lt=48][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254966246574, cache_obj->added_lc()=false, cache_obj->get_object_id()=729, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:20.696640] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:20.697711] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015A-0-0] [lt=37][errcode=-4201] hashtable not init [2025-04-21 14:09:20.697750] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015A-0-0] [lt=38] get cursor info failed(cursor_id=46, get_sessid()=3221487630) [2025-04-21 14:09:20.697883] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215760696974000, start_id=1745215760696974000, end_id=1745215760696974001) [2025-04-21 14:09:20.699491] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F028D-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.700471] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F028E-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.701548] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0290-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.702343] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:20.702528] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0291-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.715173] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0292-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.717220] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0294-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.721645] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:20.723368] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1734, avg_log_submit_to_slide_time=1755) [2025-04-21 14:09:20.723499] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=77] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=37, avg_log_submit_to_flush_time=1813, avg_log_submit_to_slide_time=1831) [2025-04-21 14:09:20.723589] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:20.730488] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215760730474], gts:1745215760730347000, latest_srr:[mts=1745215760730474]}) [2025-04-21 14:09:20.737366] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=66] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:20.750960] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:20.751025] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7775, avg_group_log_size=647) [2025-04-21 14:09:20.752978] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3842, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:20.753070] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=77] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:20.753112] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7775) [2025-04-21 14:09:20.753193] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:20.753228] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3983, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:20.753262] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=3935, avg_log_submit_to_slide_time=3959) [2025-04-21 14:09:20.753313] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:20.753458] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7775, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:20.753535] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215760229852002, v:0}, new_max_version={val:1745215760229852002, v:0}, last_min_version={val:1745215760229852000, v:0}, last_max_version={val:1745215760229852000, v:0}, total_time_us=4482, delta_us=523681) [2025-04-21 14:09:20.753581] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215760229852002, v:0}, min_version={val:1745215760229852002, v:0}, max_version={val:1745215760229852002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:20.759704] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=76] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:20.772188] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:20.772754] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:20.773407] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:20.773501] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215758791301000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:20.780608] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=85][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.793306] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=74] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:20.823606] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17389200, this={dio_aligned_buf:{buf_write_offset:1802, buf_padding_size:2294, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3212, truncate_used_ts:1237}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17387520, buf_len=122, total_write_size=13109, total_write_size_after_dio=401408, ob_pwrite_used_ts=633844, count=95, each_pwrite_cost=6672) [2025-04-21 14:09:20.827118] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:09:20.832319] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=68] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:20.836043] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:20.836098] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:20.836124] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:20.836152] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:20.836163] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:20.836179] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254965386279, flush_io_finished_ret_:0, flush_io_finished_round_:152, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:20.836594] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:20.856067] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215760856059, bytes: 5055233, bw: 0.012089 MB/s, add_ts: 1007593, add_bytes: 12772 [2025-04-21 14:09:20.880604] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0296-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.880674] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=99][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:20.882556] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0298-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.886891] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:20.886944] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.893643] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7775) [2025-04-21 14:09:20.894168] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] get number(ret=0, service_type_=0, range=1, base_id=1745215760893218000, start_id=1745215760893218000, end_id=1745215760893218001) [2025-04-21 14:09:20.902875] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:20.923096] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=73] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:20.923158] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:20.923312] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:20.925577] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=40] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:20.927608] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE73-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:20.927762] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE73-0-0] [lt=151] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:20.931721] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215760931716, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007622, add_bytes: 0 [2025-04-21 14:09:20.933651] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F029B-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.934355] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F029C-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:20.964819] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=55] current monitor number(seq_=-1) [2025-04-21 14:09:20.966838] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:20.966900] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:20.976206] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=30) [2025-04-21 14:09:20.980747] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.029030] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:21.029072] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8F-0-0] [lt=26] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:21.029090] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=59] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:21.029116] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD8F-0-0] [lt=40] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:21.029250] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=27] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:21.029376] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=40] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:21.036284] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:21.040013] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=21] === Run print tenant memory usage task === [2025-04-21 14:09:21.040087] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=36] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 136,200,192 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,761,039,589 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,079,066,624 max_mem_memstore_can_get_now= 2,458,828,800 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,761,039,589 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 71,934,340 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 549,433,344 max_mem_memstore_can_get_now= 359,671,766 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,761,039,589 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 61,896,280 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 662,396,928 max_mem_memstore_can_get_now= 309,481,466 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:21.040098] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:21.040175] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=25] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,195,035,648 total_hold= 3,365,928,960 used= 3,134,013,440 freelists_hold= 61,022,208 total_maps= 1,210 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,881,877,504 divisive_memory_used= 136,200,192 virtual_memory_used= 4,571,480,064 [CHUNK_MGR] 2 MB_CACHE: hold= 12,582,912 free= 6 pushes= 334,750 pops= 334,744 maps= 1,076 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 149 pops= 147 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:21.040231] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=29] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:21.055887] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=41] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4089, offset=83214}, end_cursor:ObLogCursor{file_id=3, log_id=4090, offset=83520}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775b0050, len:2802, log_data_len:306, seq:4089, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:21.056797] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE6D-0-0] [lt=18] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.057040] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:21.057099] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215760730347002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215760730347002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:21.058737] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.988584566116333008e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.897754739180109027e+02) [2025-04-21 14:09:21.060251] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:21.060905] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=53] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745300471149799, last_date_:0, this_date_:0, next_date_:1745300471149799, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:21.061045] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=137] check all tenants(ret=0) [2025-04-21 14:09:21.062667] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE71-0-0] [lt=14] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.063046] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=50] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4090, offset=83520}, end_cursor:ObLogCursor{file_id=3, log_id=4091, offset=83817}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775b4050, len:2496, log_data_len:297, seq:4090, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:21.064014] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE72-0-0] [lt=56] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.064088] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:21.064146] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE75-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215760730347002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215760730347002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:21.064199] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD94-0-0] [lt=38] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:21.065443] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE73-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.066177] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215751063648, end_time=1745215761066174, dag_status={}) [2025-04-21 14:09:21.066216] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066255] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066272] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066357] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:21.066375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066397] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066451] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066469] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066486] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066504] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066522] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066558] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066576] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066594] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066612] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066630] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066648] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066661] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066732] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066750] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066769] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066787] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066810] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE74-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.066824] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066843] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066897] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066933] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066953] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066972] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.066990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067009] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067026] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067062] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067081] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067116] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067135] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067171] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067207] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067234] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067288] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067306] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067341] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067359] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067378] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067414] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067449] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067467] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067502] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067520] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067538] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067592] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067611] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:21.067632] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:21.067651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:21.067685] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=32] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:21.067702] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:21.067717] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:21.067732] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:21.067747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:21.067762] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:21.067777] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:21.067792] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:21.067808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:21.068138] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE75-0-0] [lt=31] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.069468] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE76-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.070779] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE77-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.080823] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.089772] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:21.089824] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.103363] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:21.130788] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] success to update min reserved snapshot(reserved_snapshot=1745213951200391000, duration=1800, snapshot_gc_ts=1745215751200391000) [2025-04-21 14:09:21.132206] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213951200391000) [2025-04-21 14:09:21.133321] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=9166091, this={dio_aligned_buf:{buf_write_offset:3451, buf_padding_size:645, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4054, truncate_used_ts:1700}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=9162752, buf_len=112, total_write_size=372206, total_write_size_after_dio=1646592, ob_pwrite_used_ts=874903, count=311, each_pwrite_cost=2813) [2025-04-21 14:09:21.133597] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1745213951200391000) [2025-04-21 14:09:21.133628] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] update reserved snapshot finished(cost_ts=2845, reserved_snapshot=1745213951200391000) [2025-04-21 14:09:21.136380] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:21.136434] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=48] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:21.136455] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:21.136473] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:21.139653] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=20] Dumping All Cache Objs(alloc_obj_list.count()=151, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}]) [2025-04-21 14:09:21.140000] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=343] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:21.180897] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.188522] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=42] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:21.190625] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=63] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:21.190690] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=53] no transfer partition job [2025-04-21 14:09:21.190728] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=31] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:21.194559] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=35] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:21.194632] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=54] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:21.194703] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD94-0-0] [lt=50] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:21.230982] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=59] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215761230949], gts:1745215761229988000, latest_srr:[mts=1745215761230949]}) [2025-04-21 14:09:21.231055] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=71] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:21.236410] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:21.237571] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4515) [2025-04-21 14:09:21.256432] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCF-0-0] [lt=49] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:21.256500] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDCF-0-0] [lt=58] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=70) [2025-04-21 14:09:21.280967] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.292293] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] submit log success(service_type_=0, last_id=1745215777945792000, limited_id=1745215777945792000) [2025-04-21 14:09:21.292333] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] submit log with lock success(service_type_=0, last_id=1745215777945792000, limited_id=1745215777945792000) [2025-04-21 14:09:21.294166] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215777945792000, latest_scn={val:1745215761292219001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:21.294284] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=116] handle submit callback(service_type_=0, success=true, used_ts=1992, log_ts={val:1745215761292219001, v:0}, limited_id=1745215777945792000) [2025-04-21 14:09:21.294318] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=33] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:21.294348] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=27] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:21.296914] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1745215761296468000, start_id=1745215761296468000, end_id=1745215761296468001) [2025-04-21 14:09:21.301754] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE12-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:21.301796] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE12-0-0] [lt=39] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:21.303836] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:21.304109] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash time detail, (compute_wash_size_time=153, refresh_score_time=45, wash_time=0) [2025-04-21 14:09:21.327287] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015C-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.330704] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015C-0-0] [lt=52][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254966880998, cache_obj->added_lc()=false, cache_obj->get_object_id()=730, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:21.349904] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE78-0-0] [lt=37] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:21.349997] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE78-0-0] [lt=87] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.351117] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=30] get number(ret=0, service_type_=0, range=1, base_id=1745215761350089000, start_id=1745215761350089000, end_id=1745215761350089001) [2025-04-21 14:09:21.376564] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:21.376652] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:21.376828] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:21.377035] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:21.377144] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:16, schedule:51, submit:10, rt:1269, total:1347) [2025-04-21 14:09:21.377227] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:21.377311] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=71] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:16, schedule:51, submit:10, device:1269, total:1347) [2025-04-21 14:09:21.377390] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:21.377467] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:2723, total:2739) [2025-04-21 14:09:21.377547] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:21.377602] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:2723, total:2739) [2025-04-21 14:09:21.377663] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:21.377689] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:21.381034] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.387026] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:21.387082] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.422565] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:21.422840] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:09:21.436550] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:21.436901] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=60] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:21.437727] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=38] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:21.437774] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] temporary file module use no blocks [2025-04-21 14:09:21.437792] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:21.437815] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:21.437834] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254965987968, flush_io_finished_ret_:0, flush_io_finished_round_:153, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:21.465110] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=44][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:21.467057] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:21.467153] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=87] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.475390] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.475792] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.475875] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.475912] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.481103] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.504520] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=27] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:21.549674] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=49] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215761209514001, v:0}, base_version={val:1745215760730347004, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215761209514001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215761549650, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:21.551513] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8416) [2025-04-21 14:09:21.568535] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=21] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:21.568619] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=76] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:21.568639] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:21.568673] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=32] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:21.571376] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=36] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:21.572986] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=38] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:21.574462] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=58] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:21.574503] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=40] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:21.575812] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:21.575909] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:21.575939] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:21.580207] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=23] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:21.581154] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.581697] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:21.581735] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:21.581811] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=66] gc stale ls task succ [2025-04-21 14:09:21.583042] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:21.583145] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:21.583171] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=24] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:21.587318] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:21.587459] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=21] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:21.588944] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=38] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:21.588982] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:21.589053] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:21.589104] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:21.589128] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:21.589153] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:21.589177] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254966139292, flush_io_finished_ret_:0, flush_io_finished_round_:153, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:21.589314] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1745215761589251000, start_id=1745215761589251000, end_id=1745215761589251001) [2025-04-21 14:09:21.589923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:21.589972] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.590303] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:21.590418] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:21.590529] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=109] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:21.590563] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=22] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:21.590620] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=50] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:21.590641] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=19] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:21.590672] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:21.590717] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=44] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:21.590740] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=18] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:21.590757] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:21.590783] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:21.590807] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:21.590828] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=16] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:21.590845] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=16] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:21.590872] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:21.590894] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=22] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:21.592078] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:21.592118] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=38] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:21.592135] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:21.592172] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=17] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:21.592196] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=23] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:21.592216] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=18] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:21.592239] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=19] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:21.592266] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD96-0-0] [lt=25] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:21.600299] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=77] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:21.603366] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:21.603458] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:09:21.606323] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:21.606368] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:21.608045] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:21.608082] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:21.622219] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:21.622274] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:21.622306] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:21.622330] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:21.636672] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:21.637868] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:21.637915] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4094, avg_group_log_size=372) [2025-04-21 14:09:21.639210] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1543, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:21.639253] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4094) [2025-04-21 14:09:21.639287] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:21.639326] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4094) [2025-04-21 14:09:21.639430] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=75] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:21.639456] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1696, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:21.639473] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1642, avg_log_submit_to_slide_time=1673) [2025-04-21 14:09:21.639513] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=70, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:21.639553] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4094, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:21.673582] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD2-0-0] [lt=38] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:21.681223] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.693461] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015E-0-0] [lt=58][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.694881] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:21.695256] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695417] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695671] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695729] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=23] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695840] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695872] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.695971] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF015E-0-0] [lt=51][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254967246278, cache_obj->added_lc()=false, cache_obj->get_object_id()=731, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:21.696243] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.696299] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=15] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.696306] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.696375] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.696764] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:21.702793] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F029E-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.703842] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F029F-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.704679] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02A0-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.705033] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:21.705591] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02A2-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.714634] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=3400000, clean_num=200000) [2025-04-21 14:09:21.718599] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02A3-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.720317] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02A5-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.722305] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:21.722364] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:09:21.722393] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2327) [2025-04-21 14:09:21.722415] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:21.723825] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1485, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:21.723875] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:21.723926] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2449) [2025-04-21 14:09:21.724012] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:21.724041] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1635, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:21.724073] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1556, avg_log_submit_to_slide_time=1584) [2025-04-21 14:09:21.724109] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:21.724155] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2327, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:21.724208] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1512, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:21.724240] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:21.724289] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:21.724311] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1621, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:21.724330] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1594, avg_log_submit_to_slide_time=1610) [2025-04-21 14:09:21.724357] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:21.724393] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1332, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:21.732313] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE03-0-0] [lt=51] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:21.741172] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02A7-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.744373] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215761743431000, start_id=1745215761743431000, end_id=1745215761743431001) [2025-04-21 14:09:21.746864] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02AB-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.751520] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:21.751578] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8416, avg_group_log_size=601) [2025-04-21 14:09:21.753053] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1538, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:21.753106] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:21.753143] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8416) [2025-04-21 14:09:21.753206] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:21.753231] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1776, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:21.753251] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=124, avg_log_gen_to_submit_time=139, avg_log_submit_to_flush_time=1616, avg_log_submit_to_slide_time=1636) [2025-04-21 14:09:21.753307] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8416, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:21.753498] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215761231058001, v:0}, new_max_version={val:1745215761231058001, v:0}, last_min_version={val:1745215761209514001, v:0}, last_max_version={val:1745215761209514001, v:0}, total_time_us=3668, delta_us=522437) [2025-04-21 14:09:21.753543] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215761231058001, v:0}, min_version={val:1745215761231058001, v:0}, max_version={val:1745215761231058001, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:21.763203] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE01-0-0] [lt=55] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:21.781359] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:21.781401] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:21.781448] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.793423] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:21.798783] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=47] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:21.811566] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=25] ====== traversal_flush timer task ====== [2025-04-21 14:09:21.811660] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA5-0-0] [lt=38] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:21.811775] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA5-0-0] [lt=110] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:21.816289] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=31] ====== check clog disk timer task ====== [2025-04-21 14:09:21.816331] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:21.827187] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=51] gc stale ls task succ [2025-04-21 14:09:21.833949] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:21.834064] WDIAG read_multi_row (ob_table_access_helper.h:238) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:21.835586] INFO delete_row (ob_table_access_helper.h:312) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=27] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215761834092) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215761834092) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:21.836299] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:21.836348] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:21.836370] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:21.836395] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:21.836417] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254966386539, flush_io_finished_ret_:0, flush_io_finished_round_:153, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:21.836749] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:21.836757] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:21.839492] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=29] [APPLY STAT CB APPEND COST TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=65, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:21.839535] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=42] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=1520, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:21.839550] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:21.839563] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=-602, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:21.839580] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF015B-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=983, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:21.851200] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] ====== checkpoint timer task ====== [2025-04-21 14:09:21.852160] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=43] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:21.852216] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=55] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:21.852283] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:21.852377] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=89] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:21.852421] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:21.852445] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=0, rec_log_ts={val:1745215758691981001, v:0}) [2025-04-21 14:09:21.852462] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:21.852480] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:21.852503] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:21.852539] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:21.852562] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:21.852591] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:21.852622] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:21.852641] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:21.858833] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=48] clear dtl interm result cost(us)(clear_cost=2975, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:21.863705] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=83] PNIO [ratelimit] time: 1745215761863700, bytes: 5069456, bw: 0.013461 MB/s, add_ts: 1007641, add_bytes: 14223 [2025-04-21 14:09:21.869422] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=53] ====== tenant freeze timer task ====== [2025-04-21 14:09:21.881367] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:21.886423] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02AD-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.887186] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:21.887237] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.888878] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02AF-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.894564] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8416) [2025-04-21 14:09:21.894709] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:21.894945] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:21.907520] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE8-0-0] [lt=35] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215761907484}) [2025-04-21 14:09:21.907588] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE8-0-0] [lt=43] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215761907583}) [2025-04-21 14:09:21.907578] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE26-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215761907550, sql_renew_time:1745215761907550, is_mark_fail:false}]) [2025-04-21 14:09:21.907631] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE26-0-0] [lt=52] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215761907484}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215761907550, sql_renew_time:1745215761907550, is_mark_fail:false}]) [2025-04-21 14:09:21.907670] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE27-0-0] [lt=28] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:21.908092] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE27-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215761908080, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:21.908124] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE27-0-0] [lt=31] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215761907583}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215761908080, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:21.909195] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDE8-0-0] [lt=16] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:21.914754] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=39] ls blacklist refresh finish(cost_time=8523) [2025-04-21 14:09:21.915129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:21.924012] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2327) [2025-04-21 14:09:21.924140] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1832) [2025-04-21 14:09:21.924196] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1832) [2025-04-21 14:09:21.930302] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE74-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:21.930379] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE74-0-0] [lt=74] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:21.938907] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02B2-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.939555] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215761939550, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007834, add_bytes: 0 [2025-04-21 14:09:21.939736] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02B3-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:21.955151] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE05-0-0] [lt=44] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:21.958379] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=62] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:21.967338] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:21.967440] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=93] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:21.981440] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.032440] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=47] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:22.036874] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:22.040218] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=32] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:22.058346] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=27] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:22.058447] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=61] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:22.058479] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=252, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:22.058545] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:22.058615] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:22.058651] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=29, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:22.069831] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4091, offset=83817}, end_cursor:ObLogCursor{file_id=3, log_id=4092, offset=84123}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775b8050, len:2199, log_data_len:306, seq:4091, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:22.070137] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:22.070203] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215761743431002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215761743431002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:22.071960] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.988584566116333008e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.897754739180109027e+02) [2025-04-21 14:09:22.073466] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:22.076305] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=58] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4092, offset=84123}, end_cursor:ObLogCursor{file_id=3, log_id=4093, offset=84420}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775bc050, len:1893, log_data_len:297, seq:4092, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:22.076606] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:22.076664] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE76-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215761743431002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215761743431002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:22.081515] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.090101] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:22.090155] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.091060] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:22.115645] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:22.138232] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=24] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:22.138274] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] try gc retain ctx [2025-04-21 14:09:22.138289] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:22.138334] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215762093995000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215751987134001, v:0}, keep_alive_scn_:{val:1745215757090707001, v:0}, update_ts_:1745215762137644}) [2025-04-21 14:09:22.139378] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:22.181588] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.191259] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215762091899000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215762191213}, version_delta=99357) [2025-04-21 14:09:22.193646] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215761894656000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=298980, in_cluster_service=true, cluster_version={val:1745215761894656000, v:0}, min_cluster_version={val:1745215761894656000, v:0}, max_cluster_version={val:1745215761894656000, v:0}, get_cluster_version_err=0, cluster_version_delta=298980, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1413, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=99723773, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:22.231902] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=394, get_gts_with_stc_cnt=26, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=26, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:22.231965] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=59] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:22.238367] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=106] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3648) [2025-04-21 14:09:22.242151] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7400000, replace_num=100000) [2025-04-21 14:09:22.242210] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:22.250694] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17387919}], scn_array=[cnt:1, {val:1745215761743431004, v:0}], curr_size=122, accum_size=366, time_cost=28008) [2025-04-21 14:09:22.250911] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9163827}], scn_array=[cnt:1, {val:1745215761743431004, v:0}], curr_size=122, accum_size=366, time_cost=28196) [2025-04-21 14:09:22.251339] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65895391}], scn_array=[cnt:1, {val:1745215762231225000, v:0}], curr_size=122, accum_size=2234, time_cost=12952) [2025-04-21 14:09:22.281656] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.303270] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE13-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:22.303323] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE13-0-0] [lt=50] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:22.316137] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:22.334648] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0160-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.337066] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0160-0-0] [lt=66][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254967887374, cache_obj->added_lc()=false, cache_obj->get_object_id()=732, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.351585] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7A-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:22.351654] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7A-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:22.378637] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:22.378710] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:22.378888] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:22.379074] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:22.379159] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:14, schedule:41, submit:9, rt:1286, total:1350) [2025-04-21 14:09:22.379232] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:22.379292] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:14, schedule:41, submit:9, device:1286, total:1350) [2025-04-21 14:09:22.379352] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:22.379422] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:874, total:889) [2025-04-21 14:09:22.379506] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:22.379544] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:874, total:889) [2025-04-21 14:09:22.379603] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:22.379628] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:22.381733] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.387336] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:22.387399] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.408714] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=46][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:22.409522] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:22.409565] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=36] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:22.421152] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=14] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:22.422383] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:22.422479] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215761209514000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:22.422917] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:22.433516] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=46] ====== tenant freeze timer task ====== [2025-04-21 14:09:22.437138] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=74] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:22.437949] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:22.438001] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:22.438028] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:22.438051] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:22.438079] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254966988188, flush_io_finished_ret_:0, flush_io_finished_round_:154, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:22.442348] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=33] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:22.467626] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:22.467723] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=89] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.475493] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=44] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.475899] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.475982] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.476004] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.481804] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.516627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:22.545088] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8E-0-0] [lt=52] MediumCheckTask(cost_ts=17) [2025-04-21 14:09:22.552467] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:09:22.571931] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:22.572023] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=77] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:22.581881] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:09:22.581881] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.589299] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:22.589356] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:22.589374] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:22.589404] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:22.589427] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254967139536, flush_io_finished_ret_:0, flush_io_finished_round_:154, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:22.590299] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:22.590346] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.600451] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:22.602062] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:22.602116] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=41] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=31) [2025-04-21 14:09:22.606612] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:22.606660] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:22.608368] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:22.608406] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:22.622967] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:22.623024] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:22.623069] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:22.623108] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:22.626241] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:09:22.626291] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:22.626328] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:22.638677] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:22.638740] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3646, avg_group_log_size=331) [2025-04-21 14:09:22.639960] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2434, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:22.640003] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3646) [2025-04-21 14:09:22.640051] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:22.640089] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3646) [2025-04-21 14:09:22.640141] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:22.640166] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2557, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:22.640180] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=2520, avg_log_submit_to_slide_time=2537) [2025-04-21 14:09:22.640213] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:22.640248] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3646, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:22.642496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:22.652889] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:22.654102] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:22.654198] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215755597265000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:22.666667] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=24] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26357235}, readable_log_tail:{lsn:26357235}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40747533, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:22.666792] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=123] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:22.666833] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=19] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:22.681949] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.688873] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=50] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017257984, fast_delete_log_mode=false) [2025-04-21 14:09:22.694870] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] [COMPACTION DAG STATUS] (start_time=1745215752692050, end_time=1745215762694861, dag_status={}) [2025-04-21 14:09:22.694934] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.694966] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=93] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.694992] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695007] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695120] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:22.695140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695177] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695213] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695234] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695251] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695274] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695294] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695315] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695355] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695376] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695396] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695416] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695479] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695499] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695520] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695521] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695555] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:22.695586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695607] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695628] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695638] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695649] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695668] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695689] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695688] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695757] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695752] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695778] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695804] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=20] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695841] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695881] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695921] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695941] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695933] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.695962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.695985] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696005] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696025] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696066] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696087] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696128] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696147] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696168] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696250] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696240] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.696270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696292] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696304] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.696312] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696333] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696353] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696373] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696393] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696413] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696454] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696534] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:22.696595] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:22.696616] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:22.696638] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:22.696655] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:22.696674] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:22.696691] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:22.696708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:22.696726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:22.696743] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:22.696761] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:22.696780] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:22.696865] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:22.706058] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02B5-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.706582] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE00-0-0] [lt=20][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.708345] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] Garbage Collector is running(seq_=16, gc_interval=10000000) [2025-04-21 14:09:22.708418] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02B7-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.708422] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=42] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:22.708428] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE02-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.708456] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=25] gc_check_member_list_ cost time(ret=0, time_us=66) [2025-04-21 14:09:22.708482] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:22.710007] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:22.710055] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=41] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:22.710076] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=24) [2025-04-21 14:09:22.710100] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=20] ObSafeDestroyHandler start process [2025-04-21 14:09:22.710120] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:22.710150] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:22.717192] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:22.721394] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02B8-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.723036] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:22.723103] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:22.723145] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:22.723173] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:22.723618] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02BA-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.724830] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4208, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:22.724896] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:22.725032] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:22.725069] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4325, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:22.725088] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=4294, avg_log_submit_to_slide_time=4311) [2025-04-21 14:09:22.725134] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:22.725186] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:22.726041] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4346, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:22.726092] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:22.726119] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:22.726170] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:22.726199] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4467, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:22.726224] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=4424, avg_log_submit_to_slide_time=4438) [2025-04-21 14:09:22.726261] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:22.726302] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:22.732638] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215762732626], gts:1745215762732156000, latest_srr:[mts=1745215762732626]}) [2025-04-21 14:09:22.736602] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=52] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:22.752259] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:22.752326] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7773, avg_group_log_size=647) [2025-04-21 14:09:22.753960] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1684, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:22.754035] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:22.754072] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=91] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:22.754079] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7773) [2025-04-21 14:09:22.754150] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:22.754185] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1812, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:22.754215] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1770, avg_log_submit_to_slide_time=1790) [2025-04-21 14:09:22.754294] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7773, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:22.754508] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215762231225002, v:0}, new_max_version={val:1745215762231225002, v:0}, last_min_version={val:1745215762231225000, v:0}, last_max_version={val:1745215762231225000, v:0}, total_time_us=3887, delta_us=523281) [2025-04-21 14:09:22.754555] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215762231225002, v:0}, min_version={val:1745215762231225002, v:0}, max_version={val:1745215762231225002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:22.768492] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=87] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:22.782035] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.793551] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=41] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:22.813109] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16476, max_lsn:26358413, max_scn:{val:1745215762751379000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26358413}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26357824}, last_submit_end_lsn:{lsn:26358413}, last_submit_log_id:16476, last_submit_log_pid:3, max_flushed_lsn:{lsn:26357824}, max_flushed_end_lsn:{lsn:26358413}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26358413}, last_slide_log_id:16476, last_slide_scn:{val:1745215762751379000, v:0}, last_slide_lsn:{lsn:26357824}, last_slide_end_lsn:{lsn:26358413}, last_slide_log_pid:3, last_slide_log_accum_checksum:1779585106, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16477, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26358413}, readable_log_tail:{lsn:26358413}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40746355, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:22.813357] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=240] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215762754068, last_flushed_end_lsn:{lsn:26358413}}]) [2025-04-21 14:09:22.813382] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16477, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215762754068, last_flushed_end_lsn:{lsn:26358413}}]) [2025-04-21 14:09:22.827267] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:22.836540] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:22.836595] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:22.836614] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:22.836634] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:22.836661] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254967386775, flush_io_finished_ret_:0, flush_io_finished_round_:154, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:22.836921] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:22.842644] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:22.853469] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=40] new mysql sessid created(conn.sessid_=3221487824, support_ssl=false) [2025-04-21 14:09:22.853461] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0162-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215762853416}) [2025-04-21 14:09:22.853498] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE28-0-0] [lt=17] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.853556] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=40] sm conn init succ(conn.sessid_=3221487824, sess.client_addr_="127.0.0.1:54604") [2025-04-21 14:09:22.853588] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] accept one succ(*s={this:0x7f3bc7c42030, session_id:3221487824, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.853638] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=38] new mysql sessid created(conn.sessid_=3221487825, support_ssl=false) [2025-04-21 14:09:22.853662] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=62] new mysql sessid created(conn.sessid_=3221487826, support_ssl=false) [2025-04-21 14:09:22.853679] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] sm conn init succ(conn.sessid_=3221487825, sess.client_addr_="127.0.0.1:54610") [2025-04-21 14:09:22.853700] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f3bc7c42d70, session_id:3221487825, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.853736] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221487826, sess.client_addr_="127.0.0.1:54614") [2025-04-21 14:09:22.853765] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=24] accept one succ(*s={this:0x7f3bc7c44030, session_id:3221487826, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.853795] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] new mysql sessid created(conn.sessid_=3221487827, support_ssl=false) [2025-04-21 14:09:22.853865] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] new mysql sessid created(conn.sessid_=3221487828, support_ssl=false) [2025-04-21 14:09:22.853905] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=38] sm conn init succ(conn.sessid_=3221487827, sess.client_addr_="127.0.0.1:54620") [2025-04-21 14:09:22.853948] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487828, sess.client_addr_="127.0.0.1:54632") [2025-04-21 14:09:22.853937] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487827, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.853945] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE28-0-0] [lt=39] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762853919, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.853988] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=38] new mysql sessid created(conn.sessid_=3221487829, support_ssl=false) [2025-04-21 14:09:22.853978] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=24] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487828, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.853984] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE28-0-0] [lt=37] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215762853416}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762853919, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.854019] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=29] new mysql sessid created(conn.sessid_=3221487830, support_ssl=false) [2025-04-21 14:09:22.854030] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487829, sess.client_addr_="127.0.0.1:54648") [2025-04-21 14:09:22.854055] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487829, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854060] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487830, sess.client_addr_="127.0.0.1:54662") [2025-04-21 14:09:22.854083] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487830, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854104] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221487831, support_ssl=false) [2025-04-21 14:09:22.854144] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] sm conn init succ(conn.sessid_=3221487831, sess.client_addr_="127.0.0.1:54670") [2025-04-21 14:09:22.854166] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487831, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854238] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=26] new mysql sessid created(conn.sessid_=3221487832, support_ssl=false) [2025-04-21 14:09:22.854294] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221487832, sess.client_addr_="127.0.0.1:54678") [2025-04-21 14:09:22.854319] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c44d70, session_id:3221487832, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854336] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=31] new mysql sessid created(conn.sessid_=3221487833, support_ssl=false) [2025-04-21 14:09:22.854387] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221487833, sess.client_addr_="127.0.0.1:54692") [2025-04-21 14:09:22.854410] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20e8c030, session_id:3221487833, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854480] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] new mysql sessid created(conn.sessid_=3221487834, support_ssl=false) [2025-04-21 14:09:22.854550] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221487834, sess.client_addr_="127.0.0.1:54708") [2025-04-21 14:09:22.854578] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] accept one succ(*s={this:0x7f3bc7c46030, session_id:3221487834, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854617] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221487835, support_ssl=false) [2025-04-21 14:09:22.854658] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487835, sess.client_addr_="127.0.0.1:54714") [2025-04-21 14:09:22.854693] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3bc7c46d70, session_id:3221487835, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:227}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854840] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37] new mysql sessid created(conn.sessid_=3221487836, support_ssl=false) [2025-04-21 14:09:22.854892] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221487836, sess.client_addr_="127.0.0.1:54724") [2025-04-21 14:09:22.854915] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c20e8cd70, session_id:3221487836, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:228}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.854966] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855003] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855027] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=22] mysql login queue(mysql_queue->queue_.size()=0) [2025-04-21 14:09:22.855033] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855055] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=13] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855080] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=12] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855088] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=31] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855137] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855147] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBB-0-0] [lt=39] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.855156] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=13] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855197] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855212] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBA-0-0] [lt=47] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.855230] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855216] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB8-0-0] [lt=49] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.855270] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=48] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855310] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=30] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855338] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855341] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855357] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855360] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855384] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855400] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=12] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855422] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855437] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=11] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855449] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=11] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855467] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855501] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=14] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855520] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=14] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.855584] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:22.855606] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:22.856150] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB8-0-0] [lt=33] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487828, proxy_sessid=0, client_sessid=3221487828, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.856208] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBB-0-0] [lt=32] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487830, proxy_sessid=0, client_sessid=3221487830, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.856208] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBA-0-0] [lt=26] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487829, proxy_sessid=0, client_sessid=3221487829, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.856275] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB9-0-0] [lt=48] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.856335] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBC-0-0] [lt=52] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.856338] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBB-0-0] [lt=45] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.856588] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA7-0-0] [lt=18] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215762856567}) [2025-04-21 14:09:22.856595] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC9-0-0] [lt=35] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215762856576}) [2025-04-21 14:09:22.856616] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE29-0-0] [lt=27] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.856601] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=60][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215762856593}) [2025-04-21 14:09:22.856644] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC9-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215762856641}) [2025-04-21 14:09:22.856647] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=45][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215762856593}) [2025-04-21 14:09:22.856672] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDC9-0-0] [lt=21] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215762856670}) [2025-04-21 14:09:22.856685] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=36][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869375, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.856757] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=53][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215762856754}) [2025-04-21 14:09:22.856792] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=34][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215762856754}) [2025-04-21 14:09:22.856822] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=29][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747869430, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.856871] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=38][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215762856869}) [2025-04-21 14:09:22.856901] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=29][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215762856869}) [2025-04-21 14:09:22.856930] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0163-0-0] [lt=27][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872498, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.857050] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDB9-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487827, proxy_sessid=0, client_sessid=3221487827, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.857127] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBC-0-0] [lt=16] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487826, proxy_sessid=0, client_sessid=3221487826, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.857127] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBB-0-0] [lt=18] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487825, proxy_sessid=0, client_sessid=3221487825, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.857247] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBD-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.857249] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBC-0-0] [lt=39] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.857303] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE29-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857275, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.857344] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE29-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215762856567}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857275, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.857399] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2A-0-0] [lt=34] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857390, sql_renew_time:1745215762857390, is_mark_fail:false}]) [2025-04-21 14:09:22.857418] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2A-0-0] [lt=19] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215762856576}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857390, sql_renew_time:1745215762857390, is_mark_fail:false}]) [2025-04-21 14:09:22.857420] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA8-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215762857415}) [2025-04-21 14:09:22.857447] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2B-0-0] [lt=16] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857441, sql_renew_time:1745215762857441, is_mark_fail:false}]) [2025-04-21 14:09:22.857452] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA8-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215762857450}) [2025-04-21 14:09:22.857472] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2B-0-0] [lt=24] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215762856641}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857441, sql_renew_time:1745215762857441, is_mark_fail:false}]) [2025-04-21 14:09:22.857479] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA8-0-0] [lt=20] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215762857478}) [2025-04-21 14:09:22.857503] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA8-0-0] [lt=16] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215762857501}) [2025-04-21 14:09:22.857500] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2C-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.857527] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDA8-0-0] [lt=18] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215762857526}) [2025-04-21 14:09:22.857165] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBA-0-0] [lt=36] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.857961] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620069][T1_L0_G0][T1][YB420B1D7AB6-00063343B80EFD88-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215762857956}) [2025-04-21 14:09:22.858017] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBC-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487835, proxy_sessid=0, client_sessid=3221487835, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.858029] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBD-0-0] [lt=18] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487824, proxy_sessid=0, client_sessid=3221487824, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.858130] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBE-0-0] [lt=33] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.858130] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBD-0-0] [lt=38] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.858201] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487830, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215762855401, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.858271] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=58] kill and revert session(conn.sessid_=3221487830, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.858304] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=32] sock ref clean, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487830, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215762855401, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.858358] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=39] unlock session of tenant(conn.sessid_=3221487830, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.858363] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2C-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858349, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.858400] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2C-0-0] [lt=35] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215762856670}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858349, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.858382] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20] connection close(sessid=3221487830, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA7-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:22.858437] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2D-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858430, sql_renew_time:1745215762858430, is_mark_fail:false}]) [2025-04-21 14:09:22.858455] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2D-0-0] [lt=17] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215762857415}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858430, sql_renew_time:1745215762858430, is_mark_fail:false}]) [2025-04-21 14:09:22.858485] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2E-0-0] [lt=17] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858478, sql_renew_time:1745215762858478, is_mark_fail:false}]) [2025-04-21 14:09:22.858501] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2E-0-0] [lt=16] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215762857450}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858478, sql_renew_time:1745215762858478, is_mark_fail:false}]) [2025-04-21 14:09:22.858488] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBA-0-0] [lt=557] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487836, proxy_sessid=0, client_sessid=3221487836, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.858550] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2F-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858542, sql_renew_time:1745215762858542, is_mark_fail:false}]) [2025-04-21 14:09:22.858559] INFO [SERVER] run (obmp_disconnect.cpp:82) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487830) [2025-04-21 14:09:22.858573] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE2F-0-0] [lt=22] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215762857478}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858542, sql_renew_time:1745215762858542, is_mark_fail:false}]) [2025-04-21 14:09:22.858597] INFO [SERVER] run (obmp_disconnect.cpp:89) [620046][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487830) [2025-04-21 14:09:22.858598] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBB-0-0] [lt=35] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.858607] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE30-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858600, sql_renew_time:1745215762858600, is_mark_fail:false}]) [2025-04-21 14:09:22.858628] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE30-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215762857501}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858600, sql_renew_time:1745215762858600, is_mark_fail:false}]) [2025-04-21 14:09:22.858664] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE31-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858655, sql_renew_time:1745215762858655, is_mark_fail:false}]) [2025-04-21 14:09:22.858699] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE31-0-0] [lt=33] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215762857526}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858655, sql_renew_time:1745215762858655, is_mark_fail:false}]) [2025-04-21 14:09:22.858730] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE32-0-0] [lt=21] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.858801] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=11][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44030, session_id:3221487826, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.858854] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=45] kill and revert session(conn.sessid_=3221487826, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.858876] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] sock ref clean, do destroy(*s={this:0x7f3bc7c44030, session_id:3221487826, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.858911] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] unlock session of tenant(conn.sessid_=3221487826, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.858916] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBE-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487833, proxy_sessid=0, client_sessid=3221487833, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.858930] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487826, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD91-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:22.858938] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBD-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487834, proxy_sessid=0, client_sessid=3221487834, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.859026] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBF-0-0] [lt=36] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:22.859046] INFO [SERVER] run (obmp_disconnect.cpp:82) [620047][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25] free session successfully(sessid=3221487826) [2025-04-21 14:09:22.859069] INFO [SERVER] run (obmp_disconnect.cpp:89) [620047][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487826) [2025-04-21 14:09:22.859169] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD97-0-0] [lt=54] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215762859158}) [2025-04-21 14:09:22.859372] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBB-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487832, proxy_sessid=0, client_sessid=3221487832, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.859787] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD88-0-0] [lt=18] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215762859782}) [2025-04-21 14:09:22.859806] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDBF-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487831, proxy_sessid=0, client_sessid=3221487831, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:22.860387] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD90-0-0] [lt=20][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215762860380}) [2025-04-21 14:09:22.860443] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD90-0-0] [lt=55][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215762860380}) [2025-04-21 14:09:22.860475] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD90-0-0] [lt=29][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215747872132, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.860927] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD92-0-0] [lt=30] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:22.861061] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620047][T1_L0_G0][T1001][YB420B1D7AB6-00063343B88EFD92-0-0] [lt=45] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:22.861110] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620047][T1_L0_G0][T1002][YB420B1D7AB6-00063343B88EFD92-0-0] [lt=22] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:22.861168] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCA-0-0] [lt=17][errcode=0] server close connection(sessid=3221487829, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.861206] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCA-0-0] [lt=35] quit [2025-04-21 14:09:22.861261] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487829, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:219}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:0x7f3be144c110, sz:0}, need_epoll_trigger_write:false, consume_size:544, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.861310] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=40] kill and revert session(conn.sessid_=3221487829, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.861329] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] can close safely, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487829, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:219}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:0x7f3be144c110, sz:0}, need_epoll_trigger_write:false, consume_size:544, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.861363] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] unlock session of tenant(conn.sessid_=3221487829, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.861389] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] connection close(sessid=3221487829, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDC9-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.861457] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487829) [2025-04-21 14:09:22.861481] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] mark session id unused(sessid=3221487829) [2025-04-21 14:09:22.861479] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=64][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e8c030, session_id:3221487833, trace_id:YB420B1D7AB6-00063343B5DEFD98-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.862182] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=690] kill and revert session(conn.sessid_=3221487833, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.861513] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=42][errcode=0] server close connection(sessid=3221487833, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.862660] INFO [SERVER] process (obmp_quit.h:56) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=1142] quit [2025-04-21 14:09:22.862692] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=19][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.862722] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=29][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.862743] WDIAG [SERVER] response (obmp_base.cpp:87) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=20][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.862767] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=21][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.862793] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=21][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.862815] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD98-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.862835] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.861813] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42030, session_id:3221487824, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.863408] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=1585] kill and revert session(conn.sessid_=3221487824, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.863434] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] sock ref clean, do destroy(*s={this:0x7f3bc7c42030, session_id:3221487824, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.863474] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] unlock session of tenant(conn.sessid_=3221487824, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.863494] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] connection close(sessid=3221487824, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD97-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:25, seq_:31}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:32}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:22.863589] INFO [SERVER] run (obmp_disconnect.cpp:82) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] free session successfully(sessid=3221487824) [2025-04-21 14:09:22.863622] INFO [SERVER] run (obmp_disconnect.cpp:89) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=32] mark session id unused(sessid=3221487824) [2025-04-21 14:09:22.864520] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=44][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c46d70, session_id:3221487835, trace_id:YB420B1D7AB6-00063343B5DEFD99-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.864542] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=12][errcode=0] server close connection(sessid=3221487835, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.864559] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=33] kill and revert session(conn.sessid_=3221487835, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.864567] INFO [SERVER] process (obmp_quit.h:56) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=23] quit [2025-04-21 14:09:22.864581] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=12][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.864600] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=19][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.864613] WDIAG [SERVER] response (obmp_base.cpp:87) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.864631] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.864646] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.864659] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD99-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.864671] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.864640] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37] can close safely, do destroy(*s={this:0x7f3c20e8c030, session_id:3221487833, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:476, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.864717] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=54] unlock session of tenant(conn.sessid_=3221487833, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.864744] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=25] connection close(sessid=3221487833, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6BEFD8C-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.864818] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=63][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487828, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215762855401, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.864821] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] free session successfully(sessid=3221487833) [2025-04-21 14:09:22.864865] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=38] kill and revert session(conn.sessid_=3221487828, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.864865] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=43] mark session id unused(sessid=3221487833) [2025-04-21 14:09:22.864961] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=26] sock ref clean, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487828, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215762855401, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.865037] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=38] unlock session of tenant(conn.sessid_=3221487828, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.865067] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=28] connection close(sessid=3221487828, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF0163-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:22.865106] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=28] free session successfully(sessid=3221487828) [2025-04-21 14:09:22.865136] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=29] mark session id unused(sessid=3221487828) [2025-04-21 14:09:22.865216] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE32-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762865187, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.865271] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE32-0-0] [lt=52] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215762857956}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762865187, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.865343] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE33-0-0] [lt=52] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.865362] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620069][T1_L0_G0][T1][YB420B1D7AB6-00063343B80EFD88-0-0] [lt=38][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:22.865418] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215762865414, bytes: 5084693, bw: 0.014506 MB/s, add_ts: 1001714, add_bytes: 15237 [2025-04-21 14:09:22.865513] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] can close safely, do destroy(*s={this:0x7f3bc7c46d70, session_id:3221487835, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:227}, err:5, last_decode_time:1745215762860033, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.865558] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] unlock session of tenant(conn.sessid_=3221487835, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.865572] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487835, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD97-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.865624] INFO [SERVER] run (obmp_disconnect.cpp:82) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487835) [2025-04-21 14:09:22.865646] INFO [SERVER] run (obmp_disconnect.cpp:89) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487835) [2025-04-21 14:09:22.865781] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE33-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762865765, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.865820] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE33-0-0] [lt=38] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215762859158}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762865765, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.865855] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE34-0-0] [lt=21] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:22.866177] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=44][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42d70, session_id:3221487825, trace_id:YB420B1D7AB6-00063343B4AF0164-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215762865177, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.866178] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE34-0-0] [lt=14] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762866163, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.866206] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] kill and revert session(conn.sessid_=3221487825, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.866213] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE34-0-0] [lt=33] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215762859782}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762866163, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:22.866208] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=23][errcode=0] server close connection(sessid=3221487825, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.866238] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=27] quit [2025-04-21 14:09:22.866259] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=19][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.866279] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=19][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.866298] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.866317] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=18][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.866340] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866358] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0164-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866375] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866506] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=16][errcode=0] server close connection(sessid=3221487836, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.866480] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=55][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e8cd70, session_id:3221487836, trace_id:YB420B1D7AB6-00063343B4AF0165-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:228}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.866529] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=20] quit [2025-04-21 14:09:22.866541] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=51] kill and revert session(conn.sessid_=3221487836, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.866548] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=18][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.866566] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=17][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.866564] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] can close safely, do destroy(*s={this:0x7f3bc7c42d70, session_id:3221487825, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215762865177, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:798, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.866584] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.866596] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] unlock session of tenant(conn.sessid_=3221487825, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.866603] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.866603] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=12][errcode=0] server close connection(sessid=3221487834, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.866623] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866610] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487825, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B80EFD88-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.866639] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=32] quit [2025-04-21 14:09:22.866642] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0165-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866652] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c46030, session_id:3221487834, trace_id:YB420B1D7AB6-00063343B5BEFDCC-0-0, sql_handling_stage:10, sql_initiative_shutdown:true, reader:{fd:226}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.866660] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866656] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.866673] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] kill and revert session(conn.sessid_=3221487834, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.866700] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=43][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.866672] INFO [SERVER] run (obmp_disconnect.cpp:82) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11] free session successfully(sessid=3221487825) [2025-04-21 14:09:22.866715] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=14][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.866718] INFO [SERVER] run (obmp_disconnect.cpp:89) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=45] mark session id unused(sessid=3221487825) [2025-04-21 14:09:22.866728] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=12][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.866739] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] can close safely, do destroy(*s={this:0x7f3bc7c46030, session_id:3221487834, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:226}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:743, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.866744] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866777] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCC-0-0] [lt=31][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866778] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] unlock session of tenant(conn.sessid_=3221487834, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.866796] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.866796] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] connection close(sessid=3221487834, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDCB-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.866863] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487834) [2025-04-21 14:09:22.866901] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36] mark session id unused(sessid=3221487834) [2025-04-21 14:09:22.866938] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD90-0-0] [lt=42][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:22.867242] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=45][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487831, trace_id:YB420B1D7AB6-00063343B4AF0166-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.867270] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=25][errcode=0] server close connection(sessid=3221487831, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.867282] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=33] kill and revert session(conn.sessid_=3221487831, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.867302] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=30] quit [2025-04-21 14:09:22.867330] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=25][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.867357] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=26][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.867383] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=24][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.867409] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=25][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.867435] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=24][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.867462] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0166-0-0] [lt=25][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.867487] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.868384] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=55] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:22.869085] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD88-0-0] [lt=44][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:22.869544] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=44][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44d70, session_id:3221487832, trace_id:YB420B1D7AB6-00063343B4AF0167-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215762869473, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.869570] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=27][errcode=0] server close connection(sessid=3221487832, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:22.869596] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=43] kill and revert session(conn.sessid_=3221487832, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.869602] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=29] quit [2025-04-21 14:09:22.869627] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=24][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:22.869653] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=25][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:22.869678] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=23][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:22.869705] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=25][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:22.869733] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=26][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.869759] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0167-0-0] [lt=25][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.869784] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:22.882080] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:22.887516] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:22.887580] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.892527] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDC7-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.895274] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7773) [2025-04-21 14:09:22.895414] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:22.897555] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02BD-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.897640] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487831, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:223}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:22.897712] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=52] unlock session of tenant(conn.sessid_=3221487831, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.897737] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487831, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B70EFD90-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:22.897798] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=54][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487827, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.897828] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] kill and revert session(conn.sessid_=3221487827, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:22.897861] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] free session successfully(sessid=3221487831) [2025-04-21 14:09:22.897903] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=14] sock ref clean, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487827, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215762856583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:22.897926] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=62] mark session id unused(sessid=3221487831) [2025-04-21 14:09:22.897956] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=27] unlock session of tenant(conn.sessid_=3221487827, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:22.897990] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487827) [2025-04-21 14:09:22.898005] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] mark session id unused(sessid=3221487827) [2025-04-21 14:09:22.897978] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] connection close(sessid=3221487827, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA8-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:22.913139] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=38] LogLoopThread round_cost_time(us)(round_cost_time=338) [2025-04-21 14:09:22.917699] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:22.924714] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:22.924770] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:22.924884] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:22.932273] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE75-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:22.932350] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE75-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:22.935043] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=48] BlockGCTimerTask success(ret=0, cost_time_us=14, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:22.943332] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C0-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.944251] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C1-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:22.946940] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215762946936, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007386, add_bytes: 0 [2025-04-21 14:09:22.965095] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=64] current monitor number(seq_=-1) [2025-04-21 14:09:22.967879] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:22.967932] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:22.982155] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.029891] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=26] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:23.029918] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD90-0-0] [lt=29] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:23.029942] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=50] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:23.029952] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD90-0-0] [lt=30] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:23.034125] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=47] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:23.040381] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=73] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:23.042828] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=86] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:23.082223] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.082890] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4093, offset=84420}, end_cursor:ObLogCursor{file_id=3, log_id=4094, offset=84726}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775c0050, len:1596, log_data_len:306, seq:4093, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:23.083238] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:23.083302] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215762732156002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215762732156002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:23.086154] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=47] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.988584566116333008e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.897754739180109027e+02) [2025-04-21 14:09:23.088368] INFO [LIB] stat (utility.h:1176) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=74] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:23.090517] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:23.090607] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=79] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.091083] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4094, offset=84726}, end_cursor:ObLogCursor{file_id=3, log_id=4095, offset=85023}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775c4050, len:1290, log_data_len:297, seq:4094, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:23.091376] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:23.091424] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE77-0-0] [lt=29] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215762732156002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215762732156002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:23.094610] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:23.118239] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:23.182317] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.232912] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=49] ts response task statistics(alloc_count=3462, free_count=1730) [2025-04-21 14:09:23.232986] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=59] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:23.239195] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3531) [2025-04-21 14:09:23.242979] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:23.257054] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD0-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:23.257110] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD0-0-0] [lt=46] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=58) [2025-04-21 14:09:23.282385] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.304719] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE14-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:23.304777] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE14-0-0] [lt=55] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:23.318773] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=80] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:23.338594] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] can close safely, do destroy(*s={this:0x7f3c20e8cd70, session_id:3221487836, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:228}, err:5, last_decode_time:1745215762866246, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:672, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:23.338789] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=173] unlock session of tenant(conn.sessid_=3221487836, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:23.338812] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487836, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD92-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:23.338925] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=19] free session successfully(sessid=3221487836) [2025-04-21 14:09:23.338983] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=57] mark session id unused(sessid=3221487836) [2025-04-21 14:09:23.340912] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0168-0-0] [lt=11][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.343417] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0168-0-0] [lt=53][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254968893724, cache_obj->added_lc()=false, cache_obj->get_object_id()=733, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:23.353108] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7B-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:23.353174] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7B-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:23.381032] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=16kB/s, net_out=16kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:23.381123] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=65] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:23.381303] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:23.381495] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:23.381584] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8172, [delay/us]:prepare:16, schedule:37, submit:9, rt:1419, total:1482) [2025-04-21 14:09:23.381662] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:23.381733] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:16, schedule:37, submit:9, device:1419, total:1482) [2025-04-21 14:09:23.381797] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:23.381869] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4085, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:676, total:692) [2025-04-21 14:09:23.381946] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:23.381985] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:676, total:692) [2025-04-21 14:09:23.382056] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:23.382084] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:23.382454] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.387688] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:23.387742] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.423001] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=80] gc stale ls task succ [2025-04-21 14:09:23.431676] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=88] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:23.436696] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9165291}], scn_array=[cnt:1, {val:1745215763233060001, v:0}], curr_size=122, accum_size=610, time_cost=12979) [2025-04-21 14:09:23.436750] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17389383}], scn_array=[cnt:1, {val:1745215763233060001, v:0}], curr_size=122, accum_size=610, time_cost=13078) [2025-04-21 14:09:23.437305] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:23.438218] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:23.438272] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:23.438299] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:23.438326] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:23.438351] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254967988438, flush_io_finished_ret_:0, flush_io_finished_round_:155, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:23.443149] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:23.468090] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:23.468171] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.475603] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.476003] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.476015] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.476068] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.482535] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.519304] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:23.554020] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7771) [2025-04-21 14:09:23.568313] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:09:23.568464] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA4-0-0] [lt=62] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215763233060002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:23.568640] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA4-0-0] [lt=138] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:23.568713] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA4-0-0] [lt=70] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:23.581969] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:23.582959] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.590793] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:23.590870] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.600630] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:23.606770] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:23.606822] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:23.608595] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:23.608632] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:23.623803] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:23.623889] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:23.623927] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:23.623961] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:23.639490] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:23.639553] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3533, avg_group_log_size=353) [2025-04-21 14:09:23.640930] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1275, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:23.640974] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3533) [2025-04-21 14:09:23.641022] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=173, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:23.641051] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3533) [2025-04-21 14:09:23.641108] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:23.641133] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1540, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:23.641153] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1500, avg_log_submit_to_slide_time=1518) [2025-04-21 14:09:23.641186] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:23.641224] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3533, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:23.643307] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=74] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:23.666021] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:23.667091] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=53] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:23.667160] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:23.667235] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:23.667347] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=106] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:23.667375] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:23.667404] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215754222578001, v:0}) [2025-04-21 14:09:23.667424] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:23.667449] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:23.667482] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:23.667505] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:23.667538] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:23.667573] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:23.668566] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:23.668607] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:23.668656] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:23.668723] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=64] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:23.668744] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:23.668765] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:23.668787] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:23.668808] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:23.668829] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:23.668855] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:23.668873] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:23.679400] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD3-0-0] [lt=35] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:23.683033] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.694149] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1745215763694080000, start_id=1745215763694080000, end_id=1745215763694080001) [2025-04-21 14:09:23.694662] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.694858] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695584] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695667] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695732] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695802] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695816] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695868] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.695948] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.696034] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.696503] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:23.696604] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:23.710196] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE03-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.710196] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C3-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.712866] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C5-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.714076] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C6-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.715103] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=98] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:23.719792] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:23.723862] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:23.723929] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:23.723967] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:23.723996] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:23.725092] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C7-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.725701] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=85] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2818, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:23.725788] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:23.725898] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:23.725936] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2945, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:23.725962] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=2913, avg_log_submit_to_slide_time=2931) [2025-04-21 14:09:23.726010] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:23.726064] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:23.726479] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2929, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:23.726524] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:23.726543] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:23.726596] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:23.726622] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3068, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:23.726643] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=3019, avg_log_submit_to_slide_time=3035) [2025-04-21 14:09:23.726675] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:23.726724] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:23.727694] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02C9-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.729072] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=3600000, clean_num=200000) [2025-04-21 14:09:23.733440] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215763732806000, start_id=1745215763732806000, end_id=1745215763732806001) [2025-04-21 14:09:23.733523] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=52] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215763733511], gts:1745215763732806000, latest_srr:[mts=1745215763733511]}) [2025-04-21 14:09:23.753666] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=75] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:23.753754] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7771, avg_group_log_size=647) [2025-04-21 14:09:23.755612] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1507, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:23.755668] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:23.755704] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7771) [2025-04-21 14:09:23.755775] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:23.755805] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1665, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:23.755830] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=28, avg_log_gen_to_submit_time=52, avg_log_submit_to_flush_time=1590, avg_log_submit_to_slide_time=1613) [2025-04-21 14:09:23.755895] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7771, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:23.755971] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215763233060002, v:0}, new_max_version={val:1745215763233060002, v:0}, last_min_version={val:1745215763233060000, v:0}, last_max_version={val:1745215763233060000, v:0}, total_time_us=4520, delta_us=522908) [2025-04-21 14:09:23.756022] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215763233060002, v:0}, min_version={val:1745215763233060002, v:0}, max_version={val:1745215763233060002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:23.763844] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA6-0-0] [lt=45] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:23.779153] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=28] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:23.780507] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:23.780617] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=47] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215758791301000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:23.783096] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.793684] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:23.816445] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:09:23.816498] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:23.823878] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:23.823933] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=55] try gc retain ctx [2025-04-21 14:09:23.823951] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:09:23.824003] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] finish update min start scn(max_decided_scn={val:1745215763233060004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215753721686000, v:0}, keep_alive_scn_:{val:1745215758727742001, v:0}, update_ts_:1745215763823871}) [2025-04-21 14:09:23.824930] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215770473222000, latest_log_ts:{val:1745215754222578001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:23.825208] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=175] finish update min start scn(max_decided_scn={val:1745215763233060004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215753721686000, v:0}, keep_alive_scn_:{val:1745215758727742000, v:0}, update_ts_:1745215763824952}) [2025-04-21 14:09:23.826157] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215760730347002, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:23.827355] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:23.836803] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=53] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:23.836852] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:23.836869] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:23.836892] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:23.836918] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254968387033, flush_io_finished_ret_:0, flush_io_finished_round_:155, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:23.837099] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:23.843493] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=70] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:23.870533] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] can close safely, do destroy(*s={this:0x7f3bc7c44d70, session_id:3221487832, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215762869473, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:659, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:23.870616] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=63] unlock session of tenant(conn.sessid_=3221487832, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:23.870646] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=28] connection close(sessid=3221487832, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B8FEFD88-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:23.870742] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215763870737, bytes: 5099902, bw: 0.014428 MB/s, add_ts: 1005323, add_bytes: 15209 [2025-04-21 14:09:23.870768] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=44] free session successfully(sessid=3221487832) [2025-04-21 14:09:23.870803] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487832) [2025-04-21 14:09:23.871170] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:09:23.883163] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:23.887863] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:23.887945] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.896225] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7771) [2025-04-21 14:09:23.896335] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:23.900295] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02CB-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.902397] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02CD-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.925452] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:23.925514] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:23.925529] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:23.925696] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=36] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:23.929586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:23.934274] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE76-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:23.934352] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE76-0-0] [lt=74] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:23.937113] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=35] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:23.938798] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215763938283000, start_id=1745215763938283000, end_id=1745215763938283001) [2025-04-21 14:09:23.947860] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D0-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.948678] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D1-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:23.954581] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215763954576, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007640, add_bytes: 0 [2025-04-21 14:09:23.965272] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=65] current monitor number(seq_=-1) [2025-04-21 14:09:23.968341] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:23.968414] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:23.983251] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.026120] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=68, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:24.026177] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=55] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=2819, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:24.026194] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:24.026212] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=-621, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:24.026231] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=26, stat_interval=5000000, avg (count/cost)=2266, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:24.040548] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=48] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:24.043698] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=107] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:24.051685] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215763732806000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=318867, in_cluster_service=true, cluster_version={val:1745215763233060004, v:0}, min_cluster_version={val:1745215763233060004, v:0}, max_cluster_version={val:1745215763233060004, v:0}, get_cluster_version_err=0, cluster_version_delta=818613, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1398, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=94927409, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:24.083335] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.091051] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:24.091129] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=68] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.091836] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:24.091883] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:24.091904] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:24.091927] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:24.094239] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0054-0-0] [lt=47] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012583971023559570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.815989063644333328e+02) [2025-04-21 14:09:24.094547] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:24.095156] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:24.095516] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=357] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:24.098771] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4095, offset=85023}, end_cursor:ObLogCursor{file_id=3, log_id=4096, offset=85329}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775c8050, len:993, log_data_len:306, seq:4095, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:24.098883] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] get_max_applied_scn(scn={val:1745215763895588000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65902457}, palf_committed_end_scn_:{val:1745215764097133000, v:0}, last_check_scn_:{val:1745215764097133000, v:0}, max_applied_cb_scn_:{val:1745215763895588000, v:0}}) [2025-04-21 14:09:24.098959] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=67] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65902457}, readable_log_tail:{lsn:65902457}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1202311, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:24.099137] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:24.099193] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=36] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215763732806002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215763732806002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:24.099802] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:24.102103] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=13] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215762732156002, v:0}, new_replayable_scn={val:1745215762732156002, v:0}, new_readable_scn={val:1745215762732156002, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215761743431002, replayable_scn:1745215761743431002, readable_scn:1745215761743431002, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:24.102421] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=55] get number(ret=0, service_type_=0, range=1, base_id=1745215764101448000, start_id=1745215764101448000, end_id=1745215764101448001) [2025-04-21 14:09:24.105734] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=52] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4096, offset=85329}, end_cursor:ObLogCursor{file_id=3, log_id=4097, offset=85626}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775cc050, len:687, log_data_len:297, seq:4096, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:24.105997] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:24.106055] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE78-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215763732806002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215763732806002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:24.130064] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:24.183418] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.233979] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=32] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215764233941], gts:1745215764233919000, latest_srr:[mts=1745215764233941]}) [2025-04-21 14:09:24.234050] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=69] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:24.234274] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=20] submit log success(service_type_=0, last_id=1745215780473222000, limited_id=1745215780473222000) [2025-04-21 14:09:24.234310] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=34] submit log with lock success(service_type_=0, last_id=1745215780473222000, limited_id=1745215780473222000) [2025-04-21 14:09:24.234339] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=428, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:24.236151] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215780473222000, latest_scn={val:1745215764233919001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215761743431002, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:24.236239] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=87] handle submit callback(service_type_=0, success=true, used_ts=1965, log_ts={val:1745215764233919001, v:0}, limited_id=1745215780473222000) [2025-04-21 14:09:24.236259] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=18] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:24.236280] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=20] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:24.239961] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:24.243846] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:24.283477] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.296349] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=47] [APPLY STAT CB APPEND COST TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:24.296394] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=43] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=2246, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:24.296410] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:24.296428] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB EXECUTE TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=-533, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:24.296446] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=54, stat_interval=5000000, avg (count/cost)=1769, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:24.296454] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:24.296524] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] get_max_applied_scn(scn={val:1745215764152685000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26371560}, palf_committed_end_scn_:{val:1745215764294388000, v:0}, last_check_scn_:{val:1745215764294388000, v:0}, max_applied_cb_scn_:{val:1745215764152685000, v:0}}) [2025-04-21 14:09:24.296568] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26371560}, readable_log_tail:{lsn:26371560}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40733208, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:24.300285] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=44] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:24.306202] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE15-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:24.306250] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE15-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:24.330617] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:24.348020] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0169-0-0] [lt=17][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.350487] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0169-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254969900793, cache_obj->added_lc()=false, cache_obj->get_object_id()=734, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:24.354577] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7C-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:24.354644] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7C-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:24.355659] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=74] get_max_applied_scn(scn={val:1745215764233919001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17390600}, palf_committed_end_scn_:{val:1745215764233919001, v:0}, last_check_scn_:{val:1745215764233919001, v:0}, max_applied_cb_scn_:{val:1745215764233919001, v:0}}) [2025-04-21 14:09:24.355714] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17390600}, readable_log_tail:{lsn:17390600}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49714168, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:24.383176] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:24.383284] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:24.383515] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:24.383548] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.383761] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:24.383909] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=64] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:15, schedule:37, submit:7, rt:1593, total:1654) [2025-04-21 14:09:24.384018] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:24.384116] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=87] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8172, [delay/us]: prepare:15, schedule:37, submit:7, device:1593, total:1654) [2025-04-21 14:09:24.384196] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:24.384307] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:12893, total:12911) [2025-04-21 14:09:24.384410] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:24.384484] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4085, [delay/us]: prepare:0, schedule:0, submit:600000000, device:12893, total:12911) [2025-04-21 14:09:24.384569] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:24.384611] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:24.388051] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:24.388106] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.390835] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=183] clear dtl interm result cost(us)(clear_cost=9, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:24.401090] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=22] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:24.401141] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=39] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:24.401169] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=32) [2025-04-21 14:09:24.402202] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=27] ====== traversal_flush timer task ====== [2025-04-21 14:09:24.402317] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA5-0-0] [lt=38] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215764352968000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:24.402460] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA5-0-0] [lt=136] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:24.409706] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=25] ====== check clog disk timer task ====== [2025-04-21 14:09:24.409758] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:24.423100] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=66] gc stale ls task succ [2025-04-21 14:09:24.428371] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:24.428514] WDIAG read_multi_row (ob_table_access_helper.h:238) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:24.430151] INFO delete_row (ob_table_access_helper.h:312) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215764428546) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215764428546) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:24.435244] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:09:24.437465] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=32] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:24.438483] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:24.438538] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:24.438555] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:24.438582] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:24.438606] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254968988708, flush_io_finished_ret_:0, flush_io_finished_round_:156, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:24.446454] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:24.447470] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=52] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:24.447544] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=73] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:24.447628] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:24.447747] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=113] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:24.447797] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:24.447828] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215761292219001, v:0}) [2025-04-21 14:09:24.447850] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:24.447863] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:24.447888] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:24.447921] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:24.447945] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:24.447981] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:24.448017] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:24.448041] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:24.448935] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7500000, replace_num=100000) [2025-04-21 14:09:24.448984] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:24.452057] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=138] get_max_applied_scn(scn={val:1745215764233919000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9166624}, palf_committed_end_scn_:{val:1745215764233919001, v:0}, last_check_scn_:{val:1745215764233919001, v:0}, max_applied_cb_scn_:{val:1745215764233919000, v:0}}) [2025-04-21 14:09:24.452114] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=51] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9166624}, readable_log_tail:{lsn:9166624}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57938144, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:24.468593] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:24.468674] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.475393] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.475463] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.475692] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.475992] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.483637] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.531237] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=96] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:24.540148] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=68] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:24.554010] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=105] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8321) [2025-04-21 14:09:24.572189] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=36] ====== check clog disk timer task ====== [2025-04-21 14:09:24.572289] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=84] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:24.576174] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=76] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:24.582060] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=87] gc stale ls task succ [2025-04-21 14:09:24.583713] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.589635] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:24.589692] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:24.589710] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:24.589732] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:24.589758] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254969139886, flush_io_finished_ret_:0, flush_io_finished_round_:156, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:24.591278] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:24.591328] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.600815] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:24.606676] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:24.606738] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:24.608439] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:24.608476] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:24.624617] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:24.624672] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:24.624698] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:24.624721] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:24.627772] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:09:24.627824] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:24.627863] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:24.640280] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:24.640356] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=63] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:24.641724] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1306, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:24.641768] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:24.641800] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:24.641846] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:24.641903] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:24.641927] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1442, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:24.641947] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1397, avg_log_submit_to_slide_time=1417) [2025-04-21 14:09:24.641982] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:24.642023] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:24.647910] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=103] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:24.647954] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=42] try gc retain ctx [2025-04-21 14:09:24.647968] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:24.648017] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215764553759000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215754493338001, v:0}, keep_alive_scn_:{val:1745215759549521001, v:0}, update_ts_:1745215764647227}) [2025-04-21 14:09:24.648982] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:24.649108] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=29] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:24.654991] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=26] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:24.655047] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=41] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=30) [2025-04-21 14:09:24.655605] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:24.655676] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=54] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:24.655716] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=36] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:24.655748] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=29] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=30) [2025-04-21 14:09:24.683791] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.690220] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:24.690311] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=61] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=32) [2025-04-21 14:09:24.693586] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:24.693645] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=46] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:24.693669] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=32) [2025-04-21 14:09:24.694885] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695606] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695685] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695711] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695699] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=48] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695760] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=68] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695757] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=57] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695749] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695807] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695941] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.695950] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:24.697666] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=142] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:24.703202] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF016B-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.705731] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF016B-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254970256037, cache_obj->added_lc()=false, cache_obj->get_object_id()=735, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:24.707263] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF016F-0-0] [lt=50][errcode=-4201] hashtable not init [2025-04-21 14:09:24.707301] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF016F-0-0] [lt=37] get cursor info failed(cursor_id=47, get_sessid()=3221487630) [2025-04-21 14:09:24.707449] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1745215764706455000, start_id=1745215764706455000, end_id=1745215764706455001) [2025-04-21 14:09:24.714761] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D3-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.715088] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE05-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.716892] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D6-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.717213] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D7-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.724643] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:24.724704] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:09:24.724737] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:24.724764] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:24.726319] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1623, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:24.726372] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:24.726446] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:24.726500] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1726, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:24.726517] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1699, avg_log_submit_to_slide_time=1713) [2025-04-21 14:09:24.726540] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:24.726587] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:24.728747] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02D8-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.730606] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02DA-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.731762] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:24.734623] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=415, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:24.734837] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE05-0-0] [lt=33] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:24.754050] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:24.754108] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8432, avg_group_log_size=602) [2025-04-21 14:09:24.759559] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1795, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:24.759618] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:24.759660] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8432) [2025-04-21 14:09:24.759724] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:24.759750] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1945, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:24.759764] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1903, avg_log_submit_to_slide_time=1921) [2025-04-21 14:09:24.759862] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8432, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:24.759947] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215764233919002, v:0}, new_max_version={val:1745215764233919002, v:0}, last_min_version={val:1745215764233919000, v:0}, last_max_version={val:1745215764233919000, v:0}, total_time_us=7679, delta_us=526025) [2025-04-21 14:09:24.759997] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215764233919002, v:0}, min_version={val:1745215764233919002, v:0}, max_version={val:1745215764233919002, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:24.765558] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE03-0-0] [lt=37] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:24.772462] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=77] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:24.777592] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=71] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:24.783930] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:24.783967] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:24.783989] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.793814] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:24.826616] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1750, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:24.826694] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:24.826725] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1339) [2025-04-21 14:09:24.826786] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:24.826812] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1878, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:24.826831] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1836, avg_log_submit_to_slide_time=1852) [2025-04-21 14:09:24.826863] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:24.826932] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1339, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:24.827422] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=51] gc stale ls task succ [2025-04-21 14:09:24.837281] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:24.849251] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:24.878343] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215764878337, bytes: 5112674, bw: 0.012088 MB/s, add_ts: 1007600, add_bytes: 12772 [2025-04-21 14:09:24.883956] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:24.888218] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:24.888273] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.896731] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8432) [2025-04-21 14:09:24.896875] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:24.897597] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215764897326000, start_id=1745215764897326000, end_id=1745215764897326001) [2025-04-21 14:09:24.903596] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02DC-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.905448] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02DE-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.909176] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDEA-0-0] [lt=33] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:24.910641] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=47][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:24.914569] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] start to print blacklist info [2025-04-21 14:09:24.914750] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] ls blacklist refresh finish(cost_time=8400) [2025-04-21 14:09:24.918864] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=50] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:24.926339] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:24.926381] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1226) [2025-04-21 14:09:24.926439] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:24.926598] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=24] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=34, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:24.926651] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=52] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=2087, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:24.926666] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:24.926698] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=30] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-589, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:24.926726] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02AA-0-0] [lt=25] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1532, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:24.926911] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:24.926957] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=40] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:24.926990] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=29] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:24.927027] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=33] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:24.930392] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=23] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:24.931150] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=753] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:24.932252] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:24.936120] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE77-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:24.936182] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE77-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:24.953402] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E1-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.954073] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E2-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:24.957710] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE07-0-0] [lt=63] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:24.957811] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE09-0-0] [lt=46] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:24.962193] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=60] PNIO [ratelimit] time: 1745215764962189, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2025-04-21 14:09:24.965440] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=74] current monitor number(seq_=-1) [2025-04-21 14:09:24.968807] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:24.968859] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:24.984037] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.005169] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:25.008643] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8E-0-0] [lt=39] MediumCheckTask(cost_ts=12) [2025-04-21 14:09:25.030826] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=33] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:25.030864] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD91-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:25.030888] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=60] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:25.030900] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD91-0-0] [lt=33] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:25.040737] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=94] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:25.049377] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:25.058827] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=25] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:25.058953] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=72] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:25.058991] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=258, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:25.059072] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:25.059143] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:25.059168] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=29, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:25.084102] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.090138] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=55] LogLoopThread round_cost_time(us)(round_cost_time=19) [2025-04-21 14:09:25.091467] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:25.091520] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.092275] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=104] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:25.095191] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0059-0-0] [lt=98] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012583971023559570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.815989063644333328e+02) [2025-04-21 14:09:25.095537] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=67] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:25.111751] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4097, offset=85626}, end_cursor:ObLogCursor{file_id=3, log_id=4098, offset=85932}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775d0050, len:390, log_data_len:306, seq:4097, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:25.112030] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE79-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:25.112096] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE79-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215764734361002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215764734361002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:25.115175] INFO [CLOG] push_append_cb (ob_log_apply_service.cpp:422) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE79-0-0] [lt=34] apply service push_task cost too much time(thread_index=8, cb_lsn={lsn:26376439}, cb_sign=1745215765114109000, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26376383}, palf_committed_end_scn_:{val:1745215765094847000, v:0}, last_check_scn_:{val:1745215765094847000, v:0}, max_applied_cb_scn_:{val:1745215764952724000, v:0}}, push_cost=1063) [2025-04-21 14:09:25.117997] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4098, offset=85932}, end_cursor:ObLogCursor{file_id=3, log_id=4099, offset=86229}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775d4050, len:4180, log_data_len:297, seq:4098, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:25.118232] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE79-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:25.118283] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE79-0-0] [lt=33] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215764734361002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215764734361002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:25.132714] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:25.184181] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.213997] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=92] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1, avail_memory=268435456, chunk_count_=0, avail_sort_memory_=268435456, avail_memory_=268435456) [2025-04-21 14:09:25.214076] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=44] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:09:25.214130] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=49] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:09:25.235126] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:25.240750] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4094) [2025-04-21 14:09:25.249508] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:25.257726] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD1-0-0] [lt=48] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:25.257782] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD1-0-0] [lt=48] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=58) [2025-04-21 14:09:25.284258] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=88][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.293613] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215765094847000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198748, in_cluster_service=true, cluster_version={val:1745215764894113000, v:0}, min_cluster_version={val:1745215764894113000, v:0}, max_cluster_version={val:1745215764894113000, v:0}, get_cluster_version_err=0, cluster_version_delta=399482, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1410, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=100114188, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:25.307741] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE16-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:25.307795] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE16-0-0] [lt=52] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:25.333232] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:25.354453] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0171-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.354977] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get number(ret=0, service_type_=0, range=1, base_id=1745215765354788000, start_id=1745215765354788000, end_id=1745215765354788001) [2025-04-21 14:09:25.356603] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7D-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:25.356681] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7D-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:25.356952] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0171-0-0] [lt=51][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254970907257, cache_obj->added_lc()=false, cache_obj->get_object_id()=736, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:25.373333] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] success to update min reserved snapshot(reserved_snapshot=1745213955597265000, duration=1800, snapshot_gc_ts=1745215755597265000) [2025-04-21 14:09:25.373378] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] success to update min reserved snapshot(reserved_snapshot=1745213958791301000, duration=1800, snapshot_gc_ts=1745215758791301000) [2025-04-21 14:09:25.375336] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=58] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213955597265000) [2025-04-21 14:09:25.375387] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=46] update reserved snapshot finished(cost_ts=2063, reserved_snapshot=1745213955597265000) [2025-04-21 14:09:25.375436] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=35] update reserved snapshot finished(cost_ts=2062, reserved_snapshot=1745213958791301000) [2025-04-21 14:09:25.384343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.385691] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:25.385798] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:25.386018] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:25.386251] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:25.386367] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12257, [delay/us]:prepare:24, schedule:27, submit:6, rt:1314, total:1372) [2025-04-21 14:09:25.386448] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:25.386515] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12258, [delay/us]: prepare:24, schedule:27, submit:6, device:1314, total:1372) [2025-04-21 14:09:25.386574] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:25.386646] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:719, total:735) [2025-04-21 14:09:25.386740] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:25.386781] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:719, total:735) [2025-04-21 14:09:25.386843] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:25.386868] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:25.388409] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:25.388489] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.395190] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:25.396580] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDA6-0-0] [lt=47] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:25.397130] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1745215765396701000, start_id=1745215765396701000, end_id=1745215765396701001) [2025-04-21 14:09:25.398696] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65911465, this={dio_aligned_buf:{buf_write_offset:3274, buf_padding_size:822, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4092, truncate_used_ts:1687}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65908736, buf_len=545, total_write_size=38366, total_write_size_after_dio=471040, ob_pwrite_used_ts=605267, count=106, each_pwrite_cost=5710) [2025-04-21 14:09:25.423179] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=85] gc stale ls task succ [2025-04-21 14:09:25.428333] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:25.429620] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=47] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:25.429721] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215761209514000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:25.437623] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:25.438738] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:25.438792] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:25.438815] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:25.438841] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:25.438865] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254969988964, flush_io_finished_ret_:0, flush_io_finished_round_:157, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:25.441999] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=83] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:25.449650] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:25.469029] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:25.469088] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.475306] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.475353] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.475423] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.475956] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.484413] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.497597] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=82] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:25.533761] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:25.556032] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7998) [2025-04-21 14:09:25.557556] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=66] get wrs ts(ls_id={id:1}, delta=322130, log_service_ts=1745215765235399, min_tx_service_ts=4611686018427387, timestamp={val:1745215765235399001, v:0}) [2025-04-21 14:09:25.557622] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=58] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1002, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=123, Other_Error_Cnt=0, Submit_Succ_Cnt=1299, last_scn="{val:1745215763732806000, v:0}", last_lsn={lsn:17389927}, last_gts={val:1745215765235399000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:25.582131] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:25.584456] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.589891] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:25.589972] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=72] temporary file module use no blocks [2025-04-21 14:09:25.590000] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:25.590032] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=30] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:25.590059] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254970140121, flush_io_finished_ret_:0, flush_io_finished_round_:157, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:25.591645] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:25.591694] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.600966] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:25.606623] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:25.606670] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:25.608438] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:25.608477] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:25.625377] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:25.625433] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:25.649759] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:25.659821] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=24] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:25.661081] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=54] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:25.661182] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215765605373000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:25.661228] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215765605373000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1745215765605373000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:25.684527] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.687238] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD4-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:25.695024] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695768] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695806] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695831] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695845] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695873] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.695980] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.696030] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.696035] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.696837] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=74] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:25.698223] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:25.698282] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=6418, avg_group_log_size=458) [2025-04-21 14:09:25.698311] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:25.699497] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=82] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1365, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:25.699548] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=6418) [2025-04-21 14:09:25.699595] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:25.699626] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=6418) [2025-04-21 14:09:25.699683] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:25.699708] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1496, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:25.699834] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=125] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1454, avg_log_submit_to_slide_time=1472) [2025-04-21 14:09:25.699869] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:25.699908] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=6418, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:25.702134] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0172-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.704476] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0172-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254971254782, cache_obj->added_lc()=false, cache_obj->get_object_id()=737, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:25.709512] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=27] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17392186}, readable_log_tail:{lsn:17392186}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49712582, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:25.709637] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=124] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:25.709661] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=20] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9168088}, readable_log_tail:{lsn:9168088}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57936680, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:25.709730] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=68] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:25.709767] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=15] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:25.718192] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E4-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.718332] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE06-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.720289] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E7-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.720599] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E8-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.725439] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:25.725499] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:25.725534] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:25.725560] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:25.725600] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1342, avg_group_log_size=122) [2025-04-21 14:09:25.725624] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1342) [2025-04-21 14:09:25.727158] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1464, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:25.727204] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:25.727268] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:25.727310] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1589, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:25.727343] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1560, avg_log_submit_to_slide_time=1577) [2025-04-21 14:09:25.727380] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:25.727441] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:25.731718] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02E9-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.733865] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02EB-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.734337] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:25.735691] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=92] handle gts request statistics(total_rt=441, total_cnt=60, avg_rt=7.229508196721311286e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:25.735991] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215765735979], gts:1745215765735769000, latest_srr:[mts=1745215765735979]}) [2025-04-21 14:09:25.743674] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=3800000, clean_num=200000) [2025-04-21 14:09:25.752896] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=21] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:25.752939] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=38] finish to resize log external storage handler(current_ts=1745215765752935, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:25.754965] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:25.755024] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7887, avg_group_log_size=606) [2025-04-21 14:09:25.759905] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=16, gc_interval=10000000) [2025-04-21 14:09:25.759975] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:25.759996] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:25.760015] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=11] gc_check_member_list_ cost time(ret=0, time_us=72) [2025-04-21 14:09:25.760035] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=13] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:25.761238] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA5-0-0] [lt=25] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:25.761314] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA5-0-0] [lt=66] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:25.761387] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=11] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:25.762645] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:25.762700] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=48] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:25.762727] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:25.762751] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=53) [2025-04-21 14:09:25.762770] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyHandler start process [2025-04-21 14:09:25.777109] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:25.784593] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.793929] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:25.816615] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:25.816663] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=42] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:25.827197] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1487, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:25.827269] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:25.827299] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:25.827363] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:25.827388] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1633, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:25.827408] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1591, avg_log_submit_to_slide_time=1607) [2025-04-21 14:09:25.827446] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:25.827522] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:25.827503] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:25.837183] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=64] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:25.837266] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=69] temporary file module use no blocks [2025-04-21 14:09:25.837305] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=36] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:25.837337] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:25.837369] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=31] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254970387401, flush_io_finished_ret_:0, flush_io_finished_round_:157, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:25.837450] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:25.849939] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:25.855805] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=48] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:25.872720] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:25.880835] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10519, max_lsn:17392430, max_scn:{val:1745215765735769000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17392430}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17392308}, last_submit_end_lsn:{lsn:17392430}, last_submit_log_id:10519, last_submit_log_pid:3, max_flushed_lsn:{lsn:17392308}, max_flushed_end_lsn:{lsn:17392430}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17392430}, last_slide_log_id:10519, last_slide_scn:{val:1745215765735769000, v:0}, last_slide_lsn:{lsn:17392308}, last_slide_end_lsn:{lsn:17392430}, last_slide_log_pid:3, last_slide_log_accum_checksum:118193587, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10520, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17392430}, readable_log_tail:{lsn:17392430}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49712338, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:25.881104] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=262] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215765827291, last_flushed_end_lsn:{lsn:17392430}}]) [2025-04-21 14:09:25.881129] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10520, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215765827291, last_flushed_end_lsn:{lsn:17392430}}]) [2025-04-21 14:09:25.881175] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14671, max_lsn:9168332, max_scn:{val:1745215765735769000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:9168332}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:9168210}, last_submit_end_lsn:{lsn:9168332}, last_submit_log_id:14671, last_submit_log_pid:3, max_flushed_lsn:{lsn:9168210}, max_flushed_end_lsn:{lsn:9168332}, max_flushed_log_pid:3, committed_end_lsn:{lsn:9168332}, last_slide_log_id:14671, last_slide_scn:{val:1745215765735769000, v:0}, last_slide_lsn:{lsn:9168210}, last_slide_end_lsn:{lsn:9168332}, last_slide_log_pid:3, last_slide_log_accum_checksum:3535543521, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14672, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:9168332}, readable_log_tail:{lsn:9168332}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57936436, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:25.881346] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=169] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215765827474, last_flushed_end_lsn:{lsn:9168332}}]) [2025-04-21 14:09:25.881370] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14672, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215765827474, last_flushed_end_lsn:{lsn:9168332}}]) [2025-04-21 14:09:25.884660] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:25.885983] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215765885979, bytes: 5126897, bw: 0.013461 MB/s, add_ts: 1007642, add_bytes: 14223 [2025-04-21 14:09:25.888611] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:25.888697] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=76] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.897684] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1487, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:25.897729] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7887) [2025-04-21 14:09:25.897763] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:25.897801] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8476) [2025-04-21 14:09:25.897875] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:25.897899] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1618, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:25.897918] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1573, avg_log_submit_to_slide_time=1594) [2025-04-21 14:09:25.897953] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:25.897971] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8476, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:25.898044] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215765694936000, v:0}, new_max_version={val:1745215765694936000, v:0}, last_min_version={val:1745215765495344000, v:0}, last_max_version={val:1745215765495344000, v:0}, total_time_us=3955, delta_us=203104) [2025-04-21 14:09:25.898102] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215765694936000, v:0}, min_version={val:1745215765694936000, v:0}, max_version={val:1745215765694936000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:25.906620] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02ED-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.908305] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02EF-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.927180] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:25.927224] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:25.927354] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:25.938085] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE78-0-0] [lt=23] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:25.938148] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE78-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:25.944165] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:25.957964] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02F2-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.958571] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02F3-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:25.965580] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:09:25.969206] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:25.969256] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:25.969807] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=47] PNIO [ratelimit] time: 1745215765969803, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2025-04-21 14:09:25.980900] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=589) [2025-04-21 14:09:25.984744] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.006861] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=53] BlockGCTimerTask success(ret=0, cost_time_us=32, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:26.040875] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:26.050075] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:26.084829] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.091845] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:26.091905] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.095933] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF005E-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012583971023559570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.815989063644333328e+02) [2025-04-21 14:09:26.096291] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=72] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:26.108365] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=54] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:26.123852] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4099, offset=86229}, end_cursor:ObLogCursor{file_id=3, log_id=4100, offset=86535}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775d8050, len:3883, log_data_len:306, seq:4099, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:26.124132] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7A-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:26.124219] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7A-0-0] [lt=56] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215765735769002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215765735769002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:26.130075] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=57] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4100, offset=86535}, end_cursor:ObLogCursor{file_id=3, log_id=4101, offset=86832}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775dc050, len:3577, log_data_len:297, seq:4100, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:26.130354] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7A-0-0] [lt=46] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:26.130419] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7A-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215765735769002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215765735769002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:26.140157] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:26.140199] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=37] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:26.140225] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:26.140246] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:26.143398] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=17] Dumping All Cache Objs(alloc_obj_list.count()=151, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}]) [2025-04-21 14:09:26.143741] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=338] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:26.144700] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:26.184890] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.236261] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=48] ts response task statistics(alloc_count=3534, free_count=1766) [2025-04-21 14:09:26.236347] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=65] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:26.241507] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5274) [2025-04-21 14:09:26.250226] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:26.284957] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.295992] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF005F-0-0] [lt=35] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:09:26.309282] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE17-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:26.309332] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE17-0-0] [lt=48] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:26.345243] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:26.358107] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7E-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:26.358171] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7E-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:26.361028] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0174-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.363371] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0174-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254971913678, cache_obj->added_lc()=false, cache_obj->get_object_id()=738, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:26.385051] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.387928] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:26.387984] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:26.388168] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:26.388347] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:26.388429] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:16, schedule:43, submit:8, rt:1084, total:1152) [2025-04-21 14:09:26.388512] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:26.388575] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:16, schedule:43, submit:8, device:1084, total:1152) [2025-04-21 14:09:26.388636] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:26.388707] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:806, total:830) [2025-04-21 14:09:26.388783] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:26.388820] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:806, total:830) [2025-04-21 14:09:26.388879] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:26.388844] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:26.388904] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:26.388924] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.409874] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:26.409927] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=45] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:26.423254] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:09:26.437030] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:09:26.437794] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:26.450376] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:26.469394] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:26.469452] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.474542] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.474610] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.475101] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=45] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.476032] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.485127] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.545740] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=56] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:26.565316] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=42][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:26.572453] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=24] ====== check clog disk timer task ====== [2025-04-21 14:09:26.572509] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:26.582219] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:09:26.585200] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.591046] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:26.592035] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:26.592086] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.592768] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1745215766592558000, start_id=1745215766592558000, end_id=1745215766592558001) [2025-04-21 14:09:26.601176] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=62] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:26.606756] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:26.606802] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:26.608479] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:26.608517] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:26.626134] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:26.626197] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:26.629113] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:09:26.629163] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:26.629207] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:26.655413] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7600000, replace_num=100000) [2025-04-21 14:09:26.655462] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:26.685274] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.687427] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] [COMPACTION DAG STATUS] (start_time=1745215756684463, end_time=1745215766687422, dag_status={}) [2025-04-21 14:09:26.687493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=62] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687530] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=35] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687559] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687629] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=41] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687685] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:26.687756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687790] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687820] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687847] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687875] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687902] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687928] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687955] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.687999] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=43] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688026] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688052] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688079] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688106] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688132] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688189] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688217] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688245] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688303] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688331] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688387] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688413] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688440] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688467] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688511] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=43] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688540] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688624] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688650] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688677] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688705] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688731] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688757] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688785] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688811] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688838] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688876] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=36] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688925] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688952] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.688980] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689024] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=44] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689081] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689108] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689134] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689188] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689269] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689296] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689323] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689350] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689376] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689402] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689429] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689456] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689481] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689508] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689537] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689564] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689618] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689645] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689683] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:26.689740] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:26.689764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:26.689789] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:26.689816] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:26.689839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:26.689860] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:26.689882] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:26.689903] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:26.689924] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:26.689946] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:26.689969] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:26.694148] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=21] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695123] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695194] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695507] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695615] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695670] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695851] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695917] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695960] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.695968] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.696103] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:26.696955] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8363) [2025-04-21 14:09:26.697441] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=19] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215766498228000, v:0}, base_version={val:1745215766297635000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215766498228000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215766697419, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:26.698946] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215618636588, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:26.699035] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:26.699084] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:26.699117] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:26.700206] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1340, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:26.700242] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:26.700276] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:26.700313] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:26.700370] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:26.700394] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1469, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:26.700412] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1430, avg_log_submit_to_slide_time=1447) [2025-04-21 14:09:26.700445] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:26.700481] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:26.721686] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02F5-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.721754] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE07-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.723896] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE09-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.723894] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02F7-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.726201] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:26.726258] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2025-04-21 14:09:26.726293] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1644) [2025-04-21 14:09:26.726322] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:26.726359] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:26.726384] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:26.727949] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1479, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:26.727994] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:26.728092] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:26.728134] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1611, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:26.728151] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1584, avg_log_submit_to_slide_time=1597) [2025-04-21 14:09:26.728182] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:26.728215] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:26.735922] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02F8-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.736846] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215766736833], gts:1745215766736008000, latest_srr:[mts=1745215766736833]}) [2025-04-21 14:09:26.737793] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02FA-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.746291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:26.749578] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02FC-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.752452] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215766752128000, start_id=1745215766752128000, end_id=1745215766752128001) [2025-04-21 14:09:26.755037] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0300-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.756645] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:26.756716] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7774, avg_group_log_size=647) [2025-04-21 14:09:26.785340] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.785941] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:26.786228] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:26.787156] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:26.787253] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215758791301000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:26.787296] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215758791301000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1745215758791301000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:26.789767] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=91] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:26.794059] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:26.798908] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=39] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:26.811876] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:09:26.812033] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA6-0-0] [lt=77] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:26.812175] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA6-0-0] [lt=134] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:26.827580] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=61] gc stale ls task succ [2025-04-21 14:09:26.828011] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1480, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:26.828080] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:26.828109] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1644) [2025-04-21 14:09:26.828176] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:26.828201] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1627, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:26.828221] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1579, avg_log_submit_to_slide_time=1598) [2025-04-21 14:09:26.828256] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:26.828295] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1644, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:26.837505] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=57] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:26.837561] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:26.837580] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:26.837602] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:26.837605] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:26.837639] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=36] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254971387744, flush_io_finished_ret_:0, flush_io_finished_round_:158, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:26.843322] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:26.843364] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=41] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1597, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:26.843379] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:26.843392] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=11] [APPLY STAT CB EXECUTE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=-547, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:26.843409] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=17] [APPLY STAT CB TOTAL TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1111, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:26.852734] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] ====== checkpoint timer task ====== [2025-04-21 14:09:26.853725] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:26.853786] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=60] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:26.853851] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=33] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:26.853942] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=87] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:26.853990] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=38] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:26.854017] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215758691981001, v:0}) [2025-04-21 14:09:26.854038] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:26.854058] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:26.854084] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:26.854136] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=44] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:26.854190] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=48] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:26.854227] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:26.854263] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:26.854285] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:26.855574] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:26.885404] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:26.889068] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:26.889144] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.893563] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215766893559, bytes: 5139669, bw: 0.012089 MB/s, add_ts: 1007580, add_bytes: 12772 [2025-04-21 14:09:26.898120] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1387, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:26.898159] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7774) [2025-04-21 14:09:26.898197] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:26.898238] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:09:26.898312] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:26.898345] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1511, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:26.898373] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1466, avg_log_submit_to_slide_time=1488) [2025-04-21 14:09:26.898416] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=60, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:26.898434] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7774, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:26.898479] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215766696664000, v:0}, new_max_version={val:1745215766696664000, v:0}, last_min_version={val:1745215766496101000, v:0}, last_max_version={val:1745215766496101000, v:0}, total_time_us=3650, delta_us=201812) [2025-04-21 14:09:26.898525] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215766696664000, v:0}, min_version={val:1745215766696664000, v:0}, max_version={val:1745215766696664000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:26.909377] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0302-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.910912] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0304-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.925810] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=31] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:26.927804] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:09:26.927848] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1644) [2025-04-21 14:09:26.927896] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:09:26.930269] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=42] runTimer to refresh locality_info(ret=0) [2025-04-21 14:09:26.932254] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=29] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:09:26.932315] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=49] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:09:26.932344] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=28] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:09:26.932370] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=19] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:09:26.932386] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:09:26.932408] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:09:26.932423] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:09:26.932441] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:09:26.939633] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE79-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:26.939697] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE79-0-0] [lt=61] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:26.944377] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD94-0-0] [lt=28] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215762033065, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:26.944454] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD94-0-0] [lt=75] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215762034463, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:26.944476] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD94-0-0] [lt=20] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215762035839, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215762035834, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:26.946844] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:26.962305] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0307-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.962975] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0308-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:26.967751] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=67] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:26.969566] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:26.969618] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:26.977411] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215766977405, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007602, add_bytes: 0 [2025-04-21 14:09:26.985473] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.031628] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=29] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:27.031667] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD92-0-0] [lt=22] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:27.031687] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=58] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:27.031704] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD92-0-0] [lt=33] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:27.041013] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:27.055718] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:27.085541] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.092207] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:27.092260] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.096521] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:27.135842] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4101, offset=86832}, end_cursor:ObLogCursor{file_id=3, log_id=4102, offset=87138}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775e0050, len:3280, log_data_len:306, seq:4101, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:27.136134] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7B-0-0] [lt=46] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:27.136203] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7B-0-0] [lt=47] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215766752128002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215766752128002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:27.142140] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=84] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:27.142181] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] try gc retain ctx [2025-04-21 14:09:27.142196] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:27.142237] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215767099161000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215757090707001, v:0}, keep_alive_scn_:{val:1745215762093995001, v:0}, update_ts_:1745215767142213}) [2025-04-21 14:09:27.142404] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=62] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4102, offset=87138}, end_cursor:ObLogCursor{file_id=3, log_id=4103, offset=87435}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775e4050, len:2974, log_data_len:297, seq:4102, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:27.142675] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7B-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:27.142746] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7B-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215766752128002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215766752128002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:27.143244] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215775197259000, latest_log_ts:{val:1745215758691981001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:27.147359] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:27.185616] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.195146] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215767095851000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215767195069}, version_delta=99290) [2025-04-21 14:09:27.197832] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215766898968000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=298848, in_cluster_service=true, cluster_version={val:1745215766898968000, v:0}, min_cluster_version={val:1745215766898968000, v:0}, max_cluster_version={val:1745215766898968000, v:0}, get_cluster_version_err=0, cluster_version_delta=298848, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1463, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=104727953, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:27.237562] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=367, get_gts_with_stc_cnt=30, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:27.237653] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=86] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215767237519], gts:1745215767237506000, latest_srr:[mts=1745215767237519]}) [2025-04-21 14:09:27.237694] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:27.242299] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=92] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3647) [2025-04-21 14:09:27.255859] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:27.258436] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD2-0-0] [lt=54] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:27.258490] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD2-0-0] [lt=43] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=57) [2025-04-21 14:09:27.285692] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.296748] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0064-0-0] [lt=61] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012583971023559570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.815989063644333328e+02) [2025-04-21 14:09:27.297911] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:688) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=73] no need to update min/max version(new_version={val:1745215766898968000, v:0}, min_version={val:1745215766898968000, v:0}, max_version={val:1745215766898968000, v:0}) [2025-04-21 14:09:27.310969] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE18-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:27.311026] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE18-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:27.347892] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:27.359763] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7F-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:27.359843] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE7F-0-0] [lt=75] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:27.367146] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0176-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.369910] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0176-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254972920216, cache_obj->added_lc()=false, cache_obj->get_object_id()=739, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:27.385762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.389267] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:27.389354] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.389805] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:27.389880] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:27.390066] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:27.390264] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:27.390350] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:14, schedule:35, submit:8, rt:1055, total:1113) [2025-04-21 14:09:27.390431] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:27.390499] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:14, schedule:35, submit:8, device:1055, total:1113) [2025-04-21 14:09:27.390558] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:27.390647] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:808, total:823) [2025-04-21 14:09:27.390745] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:27.390786] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:808, total:823) [2025-04-21 14:09:27.390849] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:27.390877] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:27.423345] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:27.437954] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:27.439097] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:27.439160] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:27.439180] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:27.439213] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:27.439238] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254971989319, flush_io_finished_ret_:0, flush_io_finished_round_:159, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:27.450566] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:27.456009] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:27.469807] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:27.469911] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=95] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.475651] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.475736] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.476083] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.476117] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.485826] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.508937] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=63][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:27.548444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=86] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:27.582314] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:27.585902] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.590275] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:27.590341] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=58] temporary file module use no blocks [2025-04-21 14:09:27.590360] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:27.590382] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:27.590410] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254972140509, flush_io_finished_ret_:0, flush_io_finished_round_:159, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:27.592419] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:27.592490] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.601341] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=46] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:27.602244] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=26] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:27.602304] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=44] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=32) [2025-04-21 14:09:27.607220] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:27.607279] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:27.609131] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:27.609169] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:27.626820] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:27.626886] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:27.656156] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:27.685966] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.689212] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=50] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585017253888, fast_delete_log_mode=false) [2025-04-21 14:09:27.693580] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD5-0-0] [lt=50] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:27.694703] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.694762] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695346] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695593] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695596] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=48] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695651] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=24] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=61] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.695953] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.696028] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.696086] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.696289] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:27.696945] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] get number(ret=0, service_type_=0, range=1, base_id=1745215767696940000, start_id=1745215767696940000, end_id=1745215767696940001) [2025-04-21 14:09:27.697087] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:09:27.725335] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F030A-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.725352] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE0A-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.726907] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:27.726985] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:27.727032] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:27.727065] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:27.727114] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:27.727145] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:27.727462] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F030C-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.727571] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE0C-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.729099] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1642, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:27.729149] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:27.729209] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:27.729246] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1762, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:27.729266] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1728, avg_log_submit_to_slide_time=1746) [2025-04-21 14:09:27.729301] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:27.729352] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:27.736939] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=63] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:27.737347] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE07-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:27.737541] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE09-0-0] [lt=68] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:27.738193] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215767738019000, start_id=1745215767738019000, end_id=1745215767738019001) [2025-04-21 14:09:27.739016] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F030D-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.741139] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F030F-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.742720] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:27.742798] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3183, avg_group_log_size=289) [2025-04-21 14:09:27.742854] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:27.744391] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1422, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:27.744434] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3183) [2025-04-21 14:09:27.744464] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:27.744512] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3183) [2025-04-21 14:09:27.744557] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:27.744577] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1548, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:27.744595] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1501, avg_log_submit_to_slide_time=1520) [2025-04-21 14:09:27.744628] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:27.744688] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3183, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:27.749050] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=74] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:27.756826] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:27.758215] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=4000000, clean_num=200000) [2025-04-21 14:09:27.767872] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE05-0-0] [lt=36] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:27.786105] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=70] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:27.786136] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=29] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:27.786154] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.794181] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:27.802223] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:27.816759] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:27.816859] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=87] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:27.827660] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:09:27.828638] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1702, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:27.828709] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:27.828718] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:27.828773] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:27.828799] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1848, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:27.828819] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=1798, avg_log_submit_to_slide_time=1812) [2025-04-21 14:09:27.828849] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:27.828881] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:27.837764] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:27.837775] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=34] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:27.837824] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:27.837843] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:27.837866] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:27.837884] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254972387999, flush_io_finished_ret_:0, flush_io_finished_round_:159, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:27.856311] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=67] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:27.874272] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:09:27.886109] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:27.889498] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:27.889588] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=80] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.894793] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=44] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:27.897546] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8362, avg_group_log_size=643) [2025-04-21 14:09:27.899279] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1472, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:27.899331] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7773) [2025-04-21 14:09:27.899366] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:27.899411] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7773) [2025-04-21 14:09:27.899478] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:27.899504] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1599, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:27.899524] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1553, avg_log_submit_to_slide_time=1575) [2025-04-21 14:09:27.899561] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:27.899600] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7773, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:27.899645] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215767696940000, v:0}, new_max_version={val:1745215767696940000, v:0}, last_min_version={val:1745215767496222000, v:0}, last_max_version={val:1745215767496222000, v:0}, total_time_us=3998, delta_us=202702) [2025-04-21 14:09:27.899689] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215767696940000, v:0}, min_version={val:1745215767696940000, v:0}, max_version={val:1745215767696940000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:27.901203] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=38] PNIO [ratelimit] time: 1745215767901198, bytes: 5153892, bw: 0.013461 MB/s, add_ts: 1007639, add_bytes: 14223 [2025-04-21 14:09:27.909525] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDEC-0-0] [lt=33] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:27.912025] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0311-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.913804] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0313-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.915477] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=40] ls blacklist refresh finish(cost_time=9005) [2025-04-21 14:09:27.915664] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=54][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:27.915814] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=53][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:27.917184] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=40] LogLoopThread round_cost_time(us)(round_cost_time=27) [2025-04-21 14:09:27.928814] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:27.928884] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:27.928976] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:27.941567] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7A-0-0] [lt=16] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:27.941645] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7A-0-0] [lt=74] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:27.958789] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=39] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:27.960026] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE0B-0-0] [lt=28] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:27.965843] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=42] current monitor number(seq_=-1) [2025-04-21 14:09:27.967089] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0316-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.967734] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0317-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:27.970076] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:27.970138] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:27.985048] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215767985039, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007634, add_bytes: 0 [2025-04-21 14:09:27.986177] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.041144] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:28.055144] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFE1C-0-0] [lt=75] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:09:28.056460] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:28.059393] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=549433344, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=524308480, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:28.059545] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=97] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:28.059583] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=36] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=264, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:28.059666] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:28.059737] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:28.059760] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=29, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:28.086265] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.092665] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:28.092735] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.097940] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:28.117213] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=73] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:28.148362] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4103, offset=87435}, end_cursor:ObLogCursor{file_id=3, log_id=4104, offset=87741}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775e8050, len:2677, log_data_len:306, seq:4103, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:28.148776] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7C-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:28.148877] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7C-0-0] [lt=60] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215767738019002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215767738019002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:28.152453] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE7C-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215768151557000, start_id=1745215768151557000, end_id=1745215768151557001) [2025-04-21 14:09:28.155390] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=79] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4104, offset=87741}, end_cursor:ObLogCursor{file_id=3, log_id=4105, offset=88038}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775ec050, len:2371, log_data_len:297, seq:4104, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:28.155775] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7C-0-0] [lt=55] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:28.155846] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7C-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215767738019002, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215767738019002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:28.159391] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:28.186338] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=79][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.238711] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:28.256606] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:28.286406] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.297652] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0069-0-0] [lt=41] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.012583971023559570e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.815989063644333328e+02) [2025-04-21 14:09:28.312789] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE19-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:28.312851] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE19-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:28.318076] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26406386, this={dio_aligned_buf:{buf_write_offset:63, buf_padding_size:4033, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:6745, truncate_used_ts:2773}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=8192, aligned_block_offset=26402816, buf_len=589, total_write_size=81136, total_write_size_after_dio=610304, ob_pwrite_used_ts=244963, count=129, each_pwrite_cost=1898) [2025-04-21 14:09:28.318165] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=82][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26402290}], scn_array=[cnt:1, {val:1745215768297263000, v:0}], curr_size=589, accum_size=4240, time_cost=20162) [2025-04-21 14:09:28.343227] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3656) [2025-04-21 14:09:28.357049] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0073-0-0] [lt=45] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215768356447, can_tenant_elr:true}) [2025-04-21 14:09:28.360181] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:28.362755] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE80-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:28.362911] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE80-0-0] [lt=147] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:28.376138] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0177-0-0] [lt=62][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.381341] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0177-0-0] [lt=66][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254973931637, cache_obj->added_lc()=false, cache_obj->get_object_id()=740, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:28.386510] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=75][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.389796] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:28.389976] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=160] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.391916] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:28.391994] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:28.392184] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:28.392382] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:28.392473] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:19, schedule:47, submit:9, rt:1207, total:1282) [2025-04-21 14:09:28.392557] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:28.392643] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:19, schedule:47, submit:9, device:1207, total:1282) [2025-04-21 14:09:28.392733] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:28.392875] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:992, total:1010) [2025-04-21 14:09:28.392989] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:28.393061] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:992, total:1010) [2025-04-21 14:09:28.393135] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:28.393172] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:28.410072] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:28.410172] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=84] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:28.423367] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:09:28.435846] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=55] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:28.437146] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=52] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:28.437251] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215761209514000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:28.437299] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=44] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215761209514000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1745215761209514000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:28.438148] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=61] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:28.438609] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:28.439368] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:28.439417] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:28.439435] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:28.439462] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:28.439487] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254972989601, flush_io_finished_ret_:0, flush_io_finished_round_:160, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:28.456766] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:28.470331] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:28.470427] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=87] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.475773] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.475791] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=56] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.475878] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.476174] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.486574] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.558648] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=48] clear dtl interm result cost(us)(clear_cost=393, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:28.560883] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=171] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:28.568829] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:28.568970] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA5-0-0] [lt=40] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215768238592002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:28.569153] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA5-0-0] [lt=144] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:28.569225] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA5-0-0] [lt=69] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:28.572662] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:09:28.572723] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=51] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:28.582378] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=72] gc stale ls task succ [2025-04-21 14:09:28.586641] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.590548] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:28.590605] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:28.590624] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:28.590655] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:28.590696] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254973140775, flush_io_finished_ret_:0, flush_io_finished_round_:160, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:28.592863] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:28.592913] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.600773] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=59] submit log success(service_type_=0, last_id=1745215785197259000, limited_id=1745215785197259000) [2025-04-21 14:09:28.600811] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] submit log with lock success(service_type_=0, last_id=1745215785197259000, limited_id=1745215785197259000) [2025-04-21 14:09:28.601522] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:28.602729] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215785197259000, latest_scn={val:1745215768600374001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:28.602818] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=88] handle submit callback(service_type_=0, success=true, used_ts=2048, log_ts={val:1745215768600374001, v:0}, limited_id=1745215785197259000) [2025-04-21 14:09:28.602839] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=19] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:28.602865] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=24] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:28.604276] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF0170-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1745215768603598000, start_id=1745215768603598000, end_id=1745215768603598001) [2025-04-21 14:09:28.606822] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:28.606852] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:28.606885] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:28.606933] WDIAG read_multi_row (ob_table_access_helper.h:238) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:28.608496] INFO delete_row (ob_table_access_helper.h:312) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215768606961) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215768606961) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:28.608578] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:28.608608] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:28.608632] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:28.627550] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:28.627626] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:28.630511] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:28.630565] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=43] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:28.630618] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:28.656945] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:28.666524] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:28.667731] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=48] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:28.667829] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215765605373000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:28.668975] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:28.670012] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=52] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:28.670074] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=61] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:28.670146] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:28.670247] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=98] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:28.670281] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:28.670307] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215764233919001, v:0}) [2025-04-21 14:09:28.670326] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:28.670350] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:28.670381] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:28.670404] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:28.670435] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:28.670468] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:28.671461] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:28.671497] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:28.671550] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:28.671620] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:28.671638] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:28.671661] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:28.671683] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:28.671704] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:28.671732] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:28.671758] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:28.671775] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:28.686739] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.695433] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.695692] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.695683] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.695754] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.695796] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.695847] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.696045] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.696110] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.696162] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.696263] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=81] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.696398] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:28.698270] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:09:28.712878] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0179-0-0] [lt=74][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.715503] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0179-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254974265810, cache_obj->added_lc()=false, cache_obj->get_object_id()=741, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:28.716852] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF017C-0-0] [lt=52][errcode=-4201] hashtable not init [2025-04-21 14:09:28.716902] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF017C-0-0] [lt=49] get cursor info failed(cursor_id=48, get_sessid()=3221487630) [2025-04-21 14:09:28.717103] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=24] get number(ret=0, service_type_=0, range=1, base_id=1745215768716934000, start_id=1745215768716934000, end_id=1745215768716934001) [2025-04-21 14:09:28.723722] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=52] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:28.727587] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:28.727653] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:28.727691] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:28.727734] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:28.727782] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:28.727807] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:28.728701] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE0D-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.728702] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F031A-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.729392] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1985, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:28.729442] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:28.729497] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:28.729538] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2109, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:28.729554] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=2074, avg_log_submit_to_slide_time=2094) [2025-04-21 14:09:28.729587] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:28.729616] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:28.730647] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F031C-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.730710] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE0E-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.739482] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=89] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215768739464], gts:1745215768739412000, latest_srr:[mts=1745215768739464]}) [2025-04-21 14:09:28.741993] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F031D-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.743303] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F031F-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.757643] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:28.761450] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:28.764008] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA7-0-0] [lt=48] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:28.786807] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.794315] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:28.794919] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:28.800985] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:28.801070] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=4685, avg_group_log_size=390) [2025-04-21 14:09:28.801118] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:28.802746] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1645, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:28.802795] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4685) [2025-04-21 14:09:28.802830] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=59, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:28.802899] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4685) [2025-04-21 14:09:28.802950] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:28.802971] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1956, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:28.802985] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=153, avg_log_gen_to_submit_time=178, avg_log_submit_to_flush_time=1752, avg_log_submit_to_slide_time=1777) [2025-04-21 14:09:28.803020] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:28.803060] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4685, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:28.807304] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=66] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:28.827600] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:28.827646] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] try gc retain ctx [2025-04-21 14:09:28.827661] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:28.827721] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] finish update min start scn(max_decided_scn={val:1745215768238592004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215758727742001, v:0}, keep_alive_scn_:{val:1745215763732806000, v:0}, update_ts_:1745215768826996}) [2025-04-21 14:09:28.827724] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=68] gc stale ls task succ [2025-04-21 14:09:28.828664] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:28.828831] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=96] finish update min start scn(max_decided_scn={val:1745215768238592004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215758727742000, v:0}, keep_alive_scn_:{val:1745215763732806000, v:0}, update_ts_:1745215768828081}) [2025-04-21 14:09:28.829878] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215765735769003, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:28.830587] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2039, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:28.830636] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=68, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:28.830662] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:28.830731] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:28.830750] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2223, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:28.830765] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=34, avg_log_submit_to_flush_time=2167, avg_log_submit_to_slide_time=2189) [2025-04-21 14:09:28.830790] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:28.830821] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:28.837941] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:28.838025] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=50] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:28.838083] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:28.838112] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:28.838140] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:28.838165] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254973388252, flush_io_finished_ret_:0, flush_io_finished_round_:160, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:28.861987] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=81] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7700000, replace_num=100000) [2025-04-21 14:09:28.862035] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:28.886886] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.889163] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=62] ObArchiveSender is running(thread_index=1) [2025-04-21 14:09:28.890106] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:28.890176] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.899419] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=9104, avg_group_log_size=650) [2025-04-21 14:09:28.901234] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=2829, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:28.901285] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9104) [2025-04-21 14:09:28.901320] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:28.901362] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9104) [2025-04-21 14:09:28.901603] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=207] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:28.901643] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=3001, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:28.901666] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=22, avg_log_gen_to_submit_time=39, avg_log_submit_to_flush_time=2924, avg_log_submit_to_slide_time=2961) [2025-04-21 14:09:28.901717] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=74, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:28.901790] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9104, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:28.901849] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=71] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215768697583000, v:0}, new_max_version={val:1745215768697583000, v:0}, last_min_version={val:1745215768497020000, v:0}, last_max_version={val:1745215768497020000, v:0}, total_time_us=5363, delta_us=204262) [2025-04-21 14:09:28.901917] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215768697583000, v:0}, min_version={val:1745215768697583000, v:0}, max_version={val:1745215768697583000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:28.908844] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=45] PNIO [ratelimit] time: 1745215768908838, bytes: 5166664, bw: 0.012088 MB/s, add_ts: 1007640, add_bytes: 12772 [2025-04-21 14:09:28.915016] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0321-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.916894] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0323-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.929702] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:28.929790] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:28.929936] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:28.940671] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:28.942863] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=67] get number(ret=0, service_type_=0, range=1, base_id=1745215768941902000, start_id=1745215768941902000, end_id=1745215768941902001) [2025-04-21 14:09:28.943655] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7B-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:28.943768] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7B-0-0] [lt=109] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:28.961986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:28.966011] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=49] current monitor number(seq_=-1) [2025-04-21 14:09:28.970568] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:28.970636] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:28.971492] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0326-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.972128] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0327-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:28.986955] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:28.992643] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=82] PNIO [ratelimit] time: 1745215768992639, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007600, add_bytes: 0 [2025-04-21 14:09:29.001022] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215769000393000, start_id=1745215769000393000, end_id=1745215769000393001) [2025-04-21 14:09:29.003748] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:29.029816] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=24] [APPLY STAT CB APPEND COST TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=59, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:29.029864] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=47] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=1803, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:29.029890] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=25] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:29.029906] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=14] [APPLY STAT CB EXECUTE TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=-605, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:29.029920] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=27, stat_interval=5000000, avg (count/cost)=1257, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:29.032519] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:29.032579] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=59] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:29.032577] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD93-0-0] [lt=19] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:29.032627] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD93-0-0] [lt=46] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:29.034665] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=59] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:29.041324] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=80] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:29.056122] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215768739412000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=316699, in_cluster_service=true, cluster_version={val:1745215768238592004, v:0}, min_cluster_version={val:1745215768238592004, v:0}, max_cluster_version={val:1745215768238592004, v:0}, get_cluster_version_err=0, cluster_version_delta=817519, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1447, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=99931847, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:29.062146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:29.080092] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=27] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:141491012, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:109, recv_lp_rpc_cnt:0, recv_mysql_cnt:1332, recv_task_cnt:136, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:497310, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:76, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:152, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:622, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x40e:cnt=8 pcode=0x152:cnt=5, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:09:29.080919] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=826] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:09:29.080954] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=33] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:10995831, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:840040, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:09:29.081744] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=789] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:09:29.081761] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=16] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:9177957, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:419985, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:09:29.082399] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=636] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:09:29.082414] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=15] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:43908743, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:145, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:65242, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:610, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:09:29.083181] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=765] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:09:29.083213] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=32] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:72589806, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:1905, recv_task_cnt:54, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:66443, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:289, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215741776438}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:1198, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=18, token_change_ts:1745215755970093, tenant_role:1}) [2025-04-21 14:09:29.083932] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=717] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:09:29.087026] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.093060] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:29.093114] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.095678] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:29.095727] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=45] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:29.095755] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=25] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:29.095778] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:29.098458] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:29.098915] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:29.099277] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=359] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:29.099456] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] get_max_applied_scn(scn={val:1745215769000393000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65922521}, palf_committed_end_scn_:{val:1745215769000393000, v:0}, last_check_scn_:{val:1745215769000393000, v:0}, max_applied_cb_scn_:{val:1745215769000393000, v:0}}) [2025-04-21 14:09:29.099522] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65922521}, readable_log_tail:{lsn:65922521}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1182247, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:29.134821] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:29.134896] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=72] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:29.135711] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] update_check_range(min_check_version=15, max_check_version=16, global_version=17) [2025-04-21 14:09:29.161498] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=31] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 232 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 88 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 21 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 97 245 0 1002 2 33 1 0 1002 4 1 1 0 1002 5 21 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 25836 [2025-04-21 14:09:29.161580] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=50] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,079,066,624 rpc_hold: 0 cache_hold: 134,217,728 cache_used: 134,217,728 cache_item_count: 64 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:29.161614] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=88] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4105, offset=88038}, end_cursor:ObLogCursor{file_id=3, log_id=4106, offset=88344}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775f0050, len:2074, log_data_len:306, seq:4105, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:29.161898] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,451,072 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,792,320 used= 4,210,688 count= 71 avg_used= 59,305 block_cnt= 71 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,218,112 used= 3,084,912 count= 666 avg_used= 4,632 block_cnt= 666 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,603,840 used= 1,517,936 count= 42 avg_used= 36,141 block_cnt= 42 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 6 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 609,600 used= 595,200 count= 75 avg_used= 7,936 block_cnt= 75 chunk_cnt= 14 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 383,616 used= 368,064 count= 81 avg_used= 4,544 block_cnt= 81 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 227,584 used= 222,208 count= 28 avg_used= 7,936 block_cnt= 28 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 10,112 used= 7,395 count= 14 avg_used= 528 block_cnt= 13 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,768 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,451,072 used= 376,298,039 count= 32,202 avg_used= 11,685 mod=SUMMARY [2025-04-21 14:09:29.161956] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=41] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:09:29.161984] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=15] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:09:29.161955] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7D-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:29.162015] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 88,452,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 83,453,440 used= 75,789,527 count= 3,772 avg_used= 20,092 block_cnt= 3,772 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,550,144 used= 3,337,968 count= 367 avg_used= 9,095 block_cnt= 367 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,447,040 used= 1,319,360 count= 665 avg_used= 1,984 block_cnt= 222 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 88,452,608 used= 80,448,455 count= 4,806 avg_used= 16,739 mod=SUMMARY [2025-04-21 14:09:29.162026] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7D-0-0] [lt=54] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215768739412003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215768739412003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:29.162049] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:09:29.162075] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:09:29.162112] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 134,217,728 used= 134,217,728 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 mod=SUMMARY [2025-04-21 14:09:29.162141] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:09:29.162167] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:29.162194] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:29.162220] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:09:29.162263] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,748,288 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,877,568 used= 1,833,216 count= 231 avg_used= 7,936 block_cnt= 231 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,748,288 used= 19,674,944 count= 235 avg_used= 83,723 mod=SUMMARY [2025-04-21 14:09:29.162298] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:09:29.162339] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:09:29.162376] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:29.162550] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:29.162664] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,343,648 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_logical_del_time()=254974938990, cache_obj->added_lc()=false, cache_obj->get_object_id()=742, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:29.390243] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:29.390302] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.394242] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:29.394309] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:29.394487] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:29.394671] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:29.394766] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:17, schedule:37, submit:9, rt:1250, total:1314) [2025-04-21 14:09:29.394844] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:29.394910] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:17, schedule:37, submit:9, device:1250, total:1314) [2025-04-21 14:09:29.394972] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:29.395046] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1449, total:1513) [2025-04-21 14:09:29.395125] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:29.395160] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1449, total:1513) [2025-04-21 14:09:29.395221] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:29.395246] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:29.401287] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:29.401344] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=45] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:29.401374] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=25] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=33) [2025-04-21 14:09:29.402583] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=22] ====== traversal_flush timer task ====== [2025-04-21 14:09:29.402737] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA6-0-0] [lt=43] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215769357641000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:29.402885] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA6-0-0] [lt=140] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:29.423448] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:09:29.438312] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=44] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:29.439625] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:29.439680] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:29.439707] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:29.439736] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:29.439760] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254973989844, flush_io_finished_ret_:0, flush_io_finished_round_:161, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:29.448156] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:29.449142] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:29.449210] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=66] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:29.449290] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:29.449401] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=106] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:29.449448] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:29.449476] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215761292219001, v:0}) [2025-04-21 14:09:29.449494] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:29.449512] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:29.449534] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:29.449566] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:29.449588] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:29.449621] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:29.449657] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:29.449678] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:29.456493] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=93] get_max_applied_scn(scn={val:1745215769239154000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9173337}, palf_committed_end_scn_:{val:1745215769239154001, v:0}, last_check_scn_:{val:1745215769239154001, v:0}, max_applied_cb_scn_:{val:1745215769239154000, v:0}}) [2025-04-21 14:09:29.456545] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=47] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9173337}, readable_log_tail:{lsn:9173337}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57931431, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:29.460792] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=94] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:29.462428] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:29.470796] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:29.470863] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.475133] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.475893] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=56] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.475957] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.476140] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.487343] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.549677] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=45] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:29.563665] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=86] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:29.582453] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:29.587405] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.590828] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:29.590937] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=100] temporary file module use no blocks [2025-04-21 14:09:29.590958] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:29.590998] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=36] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:29.591027] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254974141057, flush_io_finished_ret_:0, flush_io_finished_round_:161, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:29.593234] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:29.593286] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.599268] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=68] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:29.601754] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=54] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:29.606770] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:29.606813] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:29.608434] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:29.608471] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:29.628323] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:29.628396] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:29.652052] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=118] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:29.652099] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=46] try gc retain ctx [2025-04-21 14:09:29.652116] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:29.652162] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=13] finish update min start scn(max_decided_scn={val:1745215769557463000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215759549521001, v:0}, keep_alive_scn_:{val:1745215764553759001, v:0}, update_ts_:1745215769651703}) [2025-04-21 14:09:29.653152] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=46] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215777945792000, latest_log_ts:{val:1745215761292219001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:29.655158] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:29.655215] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=31) [2025-04-21 14:09:29.655880] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=29] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:29.655934] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:29.655961] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=25] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:29.655981] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=18] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=31) [2025-04-21 14:09:29.662566] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:29.687477] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.690462] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=49] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:29.690526] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=46] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=33) [2025-04-21 14:09:29.693791] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=29] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:29.693903] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=87] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:29.693966] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=56] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=33) [2025-04-21 14:09:29.695128] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695193] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695256] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695528] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695542] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=55] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695594] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.695786] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=51] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.696132] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.696196] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.696240] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.696359] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:29.698897] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9764) [2025-04-21 14:09:29.699090] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD6-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:29.712236] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0180-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.714789] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0180-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254975265097, cache_obj->added_lc()=false, cache_obj->get_object_id()=743, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:29.728363] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:29.728432] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:29.728462] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:29.728484] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:29.728526] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:29.728544] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:29.730400] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1644, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:29.730490] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:29.730722] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:29.730764] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1780, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:29.730794] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1751, avg_log_submit_to_slide_time=1764) [2025-04-21 14:09:29.730825] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:29.730895] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:29.731830] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE0F-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.731830] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0329-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.733834] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F032B-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.733845] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE11-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.740466] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=41] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=401, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:29.740533] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=64] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215769740448], gts:1745215769739501000, latest_srr:[mts=1745215769740448]}) [2025-04-21 14:09:29.744169] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F032C-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.745654] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F032E-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.758476] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:29.764143] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:29.773288] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=4200000, clean_num=200000) [2025-04-21 14:09:29.787548] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.792547] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=31] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:29.793779] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:29.793874] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215768801390000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:29.794449] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:29.801502] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=108] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:29.801561] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:29.801591] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:29.803289] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1586, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:29.803335] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:29.803365] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:29.803412] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:29.803468] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:29.803483] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1722, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:29.803503] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=34, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1688) [2025-04-21 14:09:29.803536] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:29.803575] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:29.816998] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=30] ====== check clog disk timer task ====== [2025-04-21 14:09:29.817128] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=122] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:29.827819] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:29.838098] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:29.862722] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:29.870153] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=26] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65925349}, readable_log_tail:{lsn:65925349}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1179419, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:29.870334] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=179] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:09:29.870403] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=37] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:29.875868] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=52] ====== tenant freeze timer task ====== [2025-04-21 14:09:29.880853] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=17, gc_interval=10000000) [2025-04-21 14:09:29.880928] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=41] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:29.880961] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=24] gc_check_member_list_ cost time(ret=0, time_us=65) [2025-04-21 14:09:29.880989] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:29.881031] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=34] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:29.881059] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:29.881083] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=26) [2025-04-21 14:09:29.881098] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2025-04-21 14:09:29.887618] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.889023] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE35-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:29.889622] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE35-0-0] [lt=38] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215769889596, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:29.889675] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE35-0-0] [lt=51] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215769888937}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215769889596, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:29.890399] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:29.890461] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.897092] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=66] finish to resize log external storage handler(current_ts=1745215769897086, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:29.909362] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=66] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:29.916432] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=52] PNIO [ratelimit] time: 1745215769916427, bytes: 5181380, bw: 0.013929 MB/s, add_ts: 1007589, add_bytes: 14716 [2025-04-21 14:09:29.918118] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0330-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.919357] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=54] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:29.919896] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0332-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.925954] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=39] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:29.930403] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1695, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:29.930472] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=66] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:29.930504] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=65, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:29.930512] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=113] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:29.930551] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:09:29.930604] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:29.930625] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1904, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:29.930643] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=10, avg_log_gen_to_submit_time=38, avg_log_submit_to_flush_time=1843, avg_log_submit_to_slide_time=1866) [2025-04-21 14:09:29.930676] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:29.930721] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:29.930710] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:29.931286] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:29.931333] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:29.931359] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:29.931382] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:29.934672] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:29.935416] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=741] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:29.945492] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7D-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:29.945560] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7D-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:29.958415] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9023, avg_group_log_size=601) [2025-04-21 14:09:29.959846] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1450, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:29.959891] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9023) [2025-04-21 14:09:29.959925] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:29.959960] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9023) [2025-04-21 14:09:29.960013] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:29.960038] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1570, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:29.960058] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1530, avg_log_submit_to_slide_time=1548) [2025-04-21 14:09:29.960092] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:29.960139] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9023, hit_cnt=16, read_cnt=16, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:29.960141] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215769239154004, v:0}, new_max_version={val:1745215769239154004, v:0}, last_min_version={val:1745215769239154002, v:0}, last_max_version={val:1745215769239154002, v:0}, total_time_us=3311, delta_us=720984) [2025-04-21 14:09:29.960175] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215769239154004, v:0}, min_version={val:1745215769239154004, v:0}, max_version={val:1745215769239154004, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:29.966197] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=62] current monitor number(seq_=-1) [2025-04-21 14:09:29.970964] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:29.971011] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:29.973798] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43586338816, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:29.975745] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0335-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.976410] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0336-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:29.987670] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:29.993950] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14954, max_lsn:65925471, max_scn:{val:1745215769800592001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65925471}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65925349}, last_submit_end_lsn:{lsn:65925471}, last_submit_log_id:14954, last_submit_log_pid:3, max_flushed_lsn:{lsn:65925349}, max_flushed_end_lsn:{lsn:65925471}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65925471}, last_slide_log_id:14954, last_slide_scn:{val:1745215769800592001, v:0}, last_slide_lsn:{lsn:65925349}, last_slide_end_lsn:{lsn:65925471}, last_slide_log_pid:3, last_slide_log_accum_checksum:410174496, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14955, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65925471}, readable_log_tail:{lsn:65925471}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1179297, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:09:29.994382] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=424] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215769946084, last_flushed_end_lsn:{lsn:65925471}}]) [2025-04-21 14:09:29.994427] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=40] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=14955, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215769946084, last_flushed_end_lsn:{lsn:65925471}}]) [2025-04-21 14:09:30.000264] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1745215770000258, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007619, add_bytes: 0 [2025-04-21 14:09:30.010856] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=57][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:30.027855] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8E-0-0] [lt=67] MediumCheckTask(cost_ts=12) [2025-04-21 14:09:30.041446] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:30.061871] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFE1C-0-0] [lt=52][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:09:30.062999] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:30.087740] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=72][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.092808] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:30.093420] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:30.093476] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.094063] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=62] LogLoopThread round_cost_time(us)(round_cost_time=576) [2025-04-21 14:09:30.099141] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:30.119042] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=51] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:30.125964] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=80] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:30.130182] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=32, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:30.130230] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=47] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=1843, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:30.130247] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:30.130260] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=-541, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:30.130273] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F02FF-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=22, stat_interval=5000000, avg (count/cost)=1334, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:30.165156] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=70] BlockGCTimerTask success(ret=0, cost_time_us=10, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:30.173725] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=49] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4107, offset=88641}, end_cursor:ObLogCursor{file_id=3, log_id=4108, offset=88947}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775f8050, len:1471, log_data_len:306, seq:4107, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:30.174045] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7E-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:30.174110] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7E-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215769740585003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215769740585003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:30.174291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:30.179806] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=61] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4108, offset=88947}, end_cursor:ObLogCursor{file_id=3, log_id=4109, offset=89244}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c775fc050, len:1165, log_data_len:297, seq:4108, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:30.180084] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7E-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:30.180141] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7E-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215769740585003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215769740585003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:30.187807] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.203180] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:30.241056] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215770241023], gts:1745215770240117000, latest_srr:[mts=1745215770241023]}) [2025-04-21 14:09:30.241108] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:30.263121] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:30.287880] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.297507] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215770098677000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198818, in_cluster_service=true, cluster_version={val:1745215769898750000, v:0}, min_cluster_version={val:1745215769898750000, v:0}, max_cluster_version={val:1745215769898750000, v:0}, get_cluster_version_err=0, cluster_version_delta=398745, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1459, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=105118088, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:30.299205] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0073-0-0] [lt=80] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=8.013038063049316406e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=400, Throttle Trigger(MB)=240, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.814453690094105696e+02) [2025-04-21 14:09:30.316133] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1B-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:30.316191] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1B-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:30.344987] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3533) [2025-04-21 14:09:30.365678] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE82-0-0] [lt=22] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:30.365742] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE82-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:30.374986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:30.387956] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.390582] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:30.390668] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.392827] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0182-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.395337] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0182-0-0] [lt=44][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254975945645, cache_obj->added_lc()=false, cache_obj->get_object_id()=744, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:30.396296] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:30.396357] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:30.396549] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:30.396734] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:30.396817] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:14, schedule:38, submit:10, rt:1112, total:1175) [2025-04-21 14:09:30.396892] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:30.396955] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=55] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:14, schedule:38, submit:10, device:1112, total:1175) [2025-04-21 14:09:30.397034] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:30.397108] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:871, total:886) [2025-04-21 14:09:30.397183] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:30.397221] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:871, total:886) [2025-04-21 14:09:30.397277] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:30.397302] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:30.399084] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=37] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:30.400748] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215770400495000, start_id=1745215770400495000, end_id=1745215770400495001) [2025-04-21 14:09:30.410317] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:30.410362] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=39] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:30.423532] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:09:30.438482] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:30.440052] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:09:30.463243] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:30.471170] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:30.471235] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.475237] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.475473] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.475542] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.476102] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.488040] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.488340] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=86] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1002, avail_memory=53687091, chunk_count_=0, avail_sort_memory_=53687091, avail_memory_=53687091) [2025-04-21 14:09:30.493220] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=43] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:09:30.493291] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=63] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:09:30.572887] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=36] ====== check clog disk timer task ====== [2025-04-21 14:09:30.572950] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=54] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:30.575480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:30.582514] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:30.588108] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.593597] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:30.593643] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.601942] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:30.606921] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:30.606967] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:30.608653] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:30.608692] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:30.629118] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:30.629192] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:30.632265] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:09:30.632316] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=41] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:30.632372] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:30.663386] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:30.688198] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.694896] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695232] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695327] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=26] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695611] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695649] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695704] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.695733] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.696281] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.696357] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.696402] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.696458] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:30.699775] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:09:30.704017] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=30][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:30.704119] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:30.729148] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:30.729237] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:30.729270] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:30.729295] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:30.729354] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:30.729382] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:30.731035] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1567, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:30.731093] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=63, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:30.731157] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:30.731190] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1717, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:30.731205] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=15, avg_log_submit_to_flush_time=1686, avg_log_submit_to_slide_time=1702) [2025-04-21 14:09:30.731250] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:30.731274] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:30.735217] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0338-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.735217] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE12-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.737135] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F033B-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.737429] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F033C-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.739894] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE0B-0-0] [lt=36] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:30.746575] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F033D-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.748043] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F033F-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.759229] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:30.770100] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE07-0-0] [lt=44] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:30.770247] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE09-0-0] [lt=46] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:30.776007] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:30.781644] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=67] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:30.788335] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:30.788371] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=33] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:30.788397] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.794570] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:30.802784] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:30.802848] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4078, avg_group_log_size=370) [2025-04-21 14:09:30.802879] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:30.804369] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1373, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:30.804415] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4078) [2025-04-21 14:09:30.804447] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:30.804496] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4078) [2025-04-21 14:09:30.804542] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:30.804562] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1526, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:30.804575] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=34, avg_log_gen_to_submit_time=54, avg_log_submit_to_flush_time=1450, avg_log_submit_to_slide_time=1471) [2025-04-21 14:09:30.804610] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:30.804752] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3867, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:30.805892] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=77] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:30.824388] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=55] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:30.827886] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:30.830870] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17402919, this={dio_aligned_buf:{buf_write_offset:3233, buf_padding_size:863, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3382, truncate_used_ts:1321}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17399808, buf_len=122, total_write_size=13719, total_write_size_after_dio=421888, ob_pwrite_used_ts=203468, count=100, each_pwrite_cost=2034) [2025-04-21 14:09:30.838268] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:30.838365] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:30.838417] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:30.838453] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=33] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:30.838485] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:30.838511] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254975388604, flush_io_finished_ret_:0, flush_io_finished_round_:162, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:30.863557] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=75] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:30.879128] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=49] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:30.888326] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:30.890796] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:30.890857] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.907838] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDEE-0-0] [lt=42] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215770907813}) [2025-04-21 14:09:30.907923] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDEE-0-0] [lt=53] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215770907917}) [2025-04-21 14:09:30.907892] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE36-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215770907866, sql_renew_time:1745215770907866, is_mark_fail:false}]) [2025-04-21 14:09:30.907944] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE36-0-0] [lt=51] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215770907813}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215770907866, sql_renew_time:1745215770907866, is_mark_fail:false}]) [2025-04-21 14:09:30.907977] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE37-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:30.908584] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE37-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215770908572, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:30.908619] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE37-0-0] [lt=33] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215770907917}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215770908572, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:30.909548] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDEE-0-0] [lt=16] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:30.915194] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=40] start to print blacklist info [2025-04-21 14:09:30.915392] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=47] ls blacklist refresh finish(cost_time=8793) [2025-04-21 14:09:30.920988] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0341-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.922657] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0343-0-0] [lt=57][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.924033] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215770924029, bytes: 5194645, bw: 0.012555 MB/s, add_ts: 1007602, add_bytes: 13265 [2025-04-21 14:09:30.930759] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:30.930974] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1565, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:30.931015] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:30.931037] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=94, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:30.931069] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:30.931113] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:30.931136] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1746, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:30.931157] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=1695, avg_log_submit_to_slide_time=1710) [2025-04-21 14:09:30.931187] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:30.947450] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7E-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:30.947544] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7E-0-0] [lt=90] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:30.961024] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1464, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:30.961080] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7772) [2025-04-21 14:09:30.961115] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:30.961145] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7772) [2025-04-21 14:09:30.961207] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:30.961236] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1593, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:30.961257] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1552, avg_log_submit_to_slide_time=1570) [2025-04-21 14:09:30.961299] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:30.961354] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7772, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:30.961387] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215770241198004, v:0}, new_max_version={val:1745215770241198004, v:0}, last_min_version={val:1745215770241198002, v:0}, last_max_version={val:1745215770241198002, v:0}, total_time_us=3725, delta_us=720186) [2025-04-21 14:09:30.961435] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215770241198004, v:0}, min_version={val:1745215770241198004, v:0}, max_version={val:1745215770241198004, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:30.962461] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE0D-0-0] [lt=67] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:30.971378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:30.971442] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:30.976581] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:30.979964] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0346-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.980582] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0347-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:30.984934] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=43] LogLoopThread round_cost_time(us)(round_cost_time=24) [2025-04-21 14:09:30.988395] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.007892] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215771007887, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007629, add_bytes: 0 [2025-04-21 14:09:31.029623] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=18] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:31.029790] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=67] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:31.031328] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:31.031508] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:09:31.033446] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:31.033495] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=48] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:31.033499] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD94-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:31.033546] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD94-0-0] [lt=43] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:31.040326] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=25] === Run print tenant memory usage task === [2025-04-21 14:09:31.040417] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=37] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 136,200,192 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,771,039,918 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,079,066,624 max_mem_memstore_can_get_now= 2,458,828,800 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,771,039,918 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 71,724,640 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 551,530,496 max_mem_memstore_can_get_now= 358,623,216 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,771,039,918 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 61,896,280 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 662,396,928 max_mem_memstore_can_get_now= 309,481,466 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:31.040509] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,205,521,408 total_hold= 3,376,414,720 used= 3,136,110,592 freelists_hold= 69,410,816 total_maps= 1,215 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,892,363,264 divisive_memory_used= 136,200,192 virtual_memory_used= 4,581,965,824 [CHUNK_MGR] 2 MB_CACHE: hold= 20,971,520 free= 10 pushes= 338,142 pops= 338,132 maps= 1,081 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 159 pops= 157 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:31.040554] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=22] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 3991, delta_count= 3, avg_cost_time= 1330 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:31.041599] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=56] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:31.059974] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=551530496, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=522211328, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:31.060152] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=93] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:31.060187] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=33] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=269, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:31.060268] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=27] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:31.060350] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=42] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:31.060388] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=29, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:31.065666] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD95-0-0] [lt=35] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:31.068689] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1745215761066174, end_time=1745215771068684, dag_status={}) [2025-04-21 14:09:31.068689] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7800000, replace_num=100000) [2025-04-21 14:09:31.068748] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=54] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068754] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=62] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:31.068780] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068802] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068823] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068843] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068864] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068883] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068903] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068922] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:31.068943] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.068970] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.068992] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=42] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069123] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069144] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069166] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069187] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069209] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069231] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069253] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069296] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069338] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069371] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069399] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069428] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069457] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069542] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=28] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069569] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069596] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069624] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069653] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069706] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069733] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069760] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069791] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069818] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069845] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069872] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069899] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069926] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069953] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.069981] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070025] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=42] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070052] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070079] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070106] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070132] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070172] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070199] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070225] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070251] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070279] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070331] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070358] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070383] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070408] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070434] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070486] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070578] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070606] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070660] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070708] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=48] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070791] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070819] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:31.070849] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:31.070894] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=43] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:31.070915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:31.070938] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=22] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:31.070956] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:31.070973] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:31.070990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:31.071012] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:31.071035] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:31.071056] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:31.071080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:31.088470] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.093800] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:31.093873] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.100051] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8361, avg_group_log_size=643) [2025-04-21 14:09:31.100107] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:31.133731] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] success to update min reserved snapshot(reserved_snapshot=1745213961209514000, duration=1800, snapshot_gc_ts=1745215761209514000) [2025-04-21 14:09:31.136612] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=9179507, this={dio_aligned_buf:{buf_write_offset:483, buf_padding_size:3613, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4240, truncate_used_ts:1773}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=9179136, buf_len=112, total_write_size=13416, total_write_size_after_dio=425984, ob_pwrite_used_ts=198775, count=100, each_pwrite_cost=1987) [2025-04-21 14:09:31.136910] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=50] update reserved snapshot finished(cost_ts=3184, reserved_snapshot=1745213961209514000) [2025-04-21 14:09:31.143962] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=12] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:31.144027] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=57] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:31.144065] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=34] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:31.144097] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=30] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:31.147787] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=26] Dumping All Cache Objs(alloc_obj_list.count()=151, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}]) [2025-04-21 14:09:31.148539] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=746] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:31.177221] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:31.186257] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4109, offset=89244}, end_cursor:ObLogCursor{file_id=3, log_id=4110, offset=89550}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77804050, len:868, log_data_len:306, seq:4109, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:31.186709] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7F-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:31.186794] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7F-0-0] [lt=59] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215770741042004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215770741042004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:31.188539] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.194769] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=90] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4110, offset=89550}, end_cursor:ObLogCursor{file_id=3, log_id=4111, offset=89847}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77808050, len:562, log_data_len:297, seq:4110, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:31.195135] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7F-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:31.195208] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE7F-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215770741042004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215770741042004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:31.197912] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=58] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:31.199305] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=40] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:31.199346] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=39] no transfer partition job [2025-04-21 14:09:31.199365] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=14] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:31.201874] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=16] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:31.201933] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=45] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:31.201978] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD95-0-0] [lt=38] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:31.241995] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:31.259709] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD4-0-0] [lt=44] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:31.259769] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD4-0-0] [lt=52] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=63) [2025-04-21 14:09:31.268866] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=28] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:31.288618] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.299879] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0078-0-0] [lt=19] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:09:31.300171] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] submit log success(service_type_=0, last_id=1745215787945792000, limited_id=1745215787945792000) [2025-04-21 14:09:31.300206] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] submit log with lock success(service_type_=0, last_id=1745215787945792000, limited_id=1745215787945792000) [2025-04-21 14:09:31.302061] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] update id meta(ret=0, service_type=0, limited_id=1745215787945792000, latest_scn={val:1745215771299107001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:31.302164] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=101] handle submit callback(service_type_=0, success=true, used_ts=1993, log_ts={val:1745215771299107001, v:0}, limited_id=1745215787945792000) [2025-04-21 14:09:31.302185] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=20] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:31.302201] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:31.303753] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1745215771303437000, start_id=1745215771303437000, end_id=1745215771303437001) [2025-04-21 14:09:31.317964] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1C-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:31.318025] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1C-0-0] [lt=59] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:31.345743] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4078) [2025-04-21 14:09:31.359600] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0082-0-0] [lt=27] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:31.360025] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65930839}], scn_array=[cnt:1, {val:1745215771241946000, v:0}], curr_size=122, accum_size=1534, time_cost=14259) [2025-04-21 14:09:31.367248] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE83-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:31.367316] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE83-0-0] [lt=65] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:31.378046] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:31.388685] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.390986] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:31.391072] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.398336] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=14kB/s, net_out=14kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:31.398478] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=119] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:31.398672] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=29] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:31.398876] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:31.398958] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:27, schedule:67, submit:9, rt:1467, total:1570) [2025-04-21 14:09:31.399035] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:31.399095] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:27, schedule:67, submit:9, device:1467, total:1570) [2025-04-21 14:09:31.399155] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:31.399177] WDIAG begin (ob_hashtable.h:954) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8E-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.399237] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:948, total:963) [2025-04-21 14:09:31.399324] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:31.399381] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:948, total:963) [2025-04-21 14:09:31.399452] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:31.399478] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:31.401894] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8E-0-0] [lt=33][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254976952200, cache_obj->added_lc()=false, cache_obj->get_object_id()=745, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:31.404928] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:31.423602] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:31.438652] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:31.439977] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:31.440031] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:31.440050] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:31.440077] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:31.440104] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254975990212, flush_io_finished_ret_:0, flush_io_finished_round_:163, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:31.443157] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:31.443499] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17400238}], scn_array=[cnt:1, {val:1745215771241946000, v:0}], curr_size=122, accum_size=1293, time_cost=13652) [2025-04-21 14:09:31.443744] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=83][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9175645}], scn_array=[cnt:1, {val:1745215771241946000, v:0}], curr_size=122, accum_size=600, time_cost=13965) [2025-04-21 14:09:31.444448] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=49] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:31.444550] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215771218295000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:31.469021] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:31.469060] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=105] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:31.471619] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:31.471684] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.475224] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.475311] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.475351] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.476133] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=53] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.488753] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.558096] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=64] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215771218295001, v:0}, base_version={val:1745215770741042004, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215771218295001, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215771558065, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:31.578606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:31.582599] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:31.588835] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.591268] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:31.591361] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=83] temporary file module use no blocks [2025-04-21 14:09:31.591399] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=35] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:31.591430] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:31.591459] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254976141473, flush_io_finished_ret_:0, flush_io_finished_round_:163, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:31.594060] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:31.594145] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.594797] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:31.596391] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215771595752000, start_id=1745215771595752000, end_id=1745215771595752001) [2025-04-21 14:09:31.598138] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=19] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:31.598227] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=80] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:31.598247] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:31.598277] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=28] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:31.601054] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=30] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:31.602162] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=68] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:31.602709] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=38] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:31.604369] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=40] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:31.604411] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:31.605739] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:31.605839] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=39] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:31.605869] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=27] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:31.606947] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:31.606989] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:31.608762] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:31.608891] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=128][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:31.610145] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=19] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:31.611633] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:31.611672] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:31.612966] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:31.613087] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=53] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:31.613117] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=28] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:31.617478] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=20] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:31.618999] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=39] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:31.619039] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:31.620346] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:31.620460] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:31.620489] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:31.620525] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=23] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:31.620600] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=68] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:31.620617] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=14] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:31.620649] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=27] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:31.620682] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=32] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:31.620701] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=13] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:31.620714] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=12] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:31.620736] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:31.620759] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=22] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:31.620782] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=19] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:31.620794] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=12] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:31.620820] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:31.620841] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=21] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:31.622067] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:31.622108] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=38] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:31.622125] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=14] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:31.622157] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=13] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:31.622185] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=26] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:31.622204] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=18] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:31.622227] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=19] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:31.622254] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD97-0-0] [lt=26] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:31.629868] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:31.629956] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:31.665503] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=73][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:31.669173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=63] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:31.673332] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:31.674525] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:31.674618] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215765605373000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:31.688910] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.695071] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695126] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695364] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695459] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=72] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695720] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=62] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695832] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=43] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.695900] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.696008] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=65] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.696071] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.696112] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.696484] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:31.700169] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=13] get number(ret=0, service_type_=0, range=1, base_id=1745215771699546000, start_id=1745215771699546000, end_id=1745215771699546001) [2025-04-21 14:09:31.700288] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8417) [2025-04-21 14:09:31.704993] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD7-0-0] [lt=149] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:31.729894] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:31.729948] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=2327, avg_group_log_size=232) [2025-04-21 14:09:31.729979] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2327) [2025-04-21 14:09:31.730006] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:31.730046] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:31.730077] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:31.731502] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2753, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:31.731563] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=80, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:31.731680] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:31.731706] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2928, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:31.731720] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=2885, avg_log_submit_to_slide_time=2908) [2025-04-21 14:09:31.731755] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:31.731772] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1210, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:31.738335] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0349-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.738338] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE13-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.740315] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE15-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.740346] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F034B-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.742450] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] get number(ret=0, service_type_=0, range=1, base_id=1745215771742244000, start_id=1745215771742244000, end_id=1745215771742244001) [2025-04-21 14:09:31.742706] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=41] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215771742679], gts:1745215771742244000, latest_srr:[mts=1745215771742679]}) [2025-04-21 14:09:31.748831] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F034C-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.750381] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F034E-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.757346] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0350-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.760218] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1745215771760190000, start_id=1745215771760190000, end_id=1745215771760190001) [2025-04-21 14:09:31.760365] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=82] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:31.762566] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0354-0-0] [lt=53][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.779160] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:31.788982] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.793321] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=4400000, clean_num=200000) [2025-04-21 14:09:31.794730] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=48] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:31.799044] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=39] XA scheduler heartbeat task statistics(avg_time=3) [2025-04-21 14:09:31.803398] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:31.803457] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3532, avg_group_log_size=353) [2025-04-21 14:09:31.803486] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:31.805049] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2780, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:31.805091] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3532) [2025-04-21 14:09:31.805122] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:31.805164] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3532) [2025-04-21 14:09:31.805210] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:31.805224] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2911, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:31.805237] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=2865, avg_log_submit_to_slide_time=2884) [2025-04-21 14:09:31.805265] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:31.805361] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3743, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:31.812277] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:09:31.812383] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA7-0-0] [lt=42] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:31.812537] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA7-0-0] [lt=145] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:31.817256] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:31.817310] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=45] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:31.827957] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=65] gc stale ls task succ [2025-04-21 14:09:31.838463] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=61] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:31.838651] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:31.838718] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:09:31.838736] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:31.838765] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:31.838789] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254976388871, flush_io_finished_ret_:0, flush_io_finished_round_:163, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:31.841449] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:31.841578] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:31.843116] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=27] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215771841606) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215771841606) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:31.854395] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] ====== checkpoint timer task ====== [2025-04-21 14:09:31.855361] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:31.855426] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=63] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:31.855501] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:31.855607] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=101] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:31.855652] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:31.855679] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215768600374001, v:0}) [2025-04-21 14:09:31.855698] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:31.855716] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:31.855739] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:31.855771] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:31.855793] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:31.855823] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:31.855855] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:31.855876] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:31.861995] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=19] clear dtl interm result cost(us)(clear_cost=2982, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:31.869300] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:31.877549] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:31.889051] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.891191] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=35] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:31.891277] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.923699] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0356-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.925309] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0358-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.931653] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215771931648, bytes: 5208868, bw: 0.013462 MB/s, add_ts: 1007619, add_bytes: 14223 [2025-04-21 14:09:31.931836] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2876, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:31.931876] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2327) [2025-04-21 14:09:31.931907] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=74, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:31.931890] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1832) [2025-04-21 14:09:31.931955] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2327) [2025-04-21 14:09:31.932002] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:31.932025] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3057, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:31.932044] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=3009, avg_log_submit_to_slide_time=3027) [2025-04-21 14:09:31.932076] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:31.947702] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=39] [APPLY STAT CB APPEND COST TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=65, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:31.947740] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=36] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=1935, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:31.947757] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:31.947779] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=21] [APPLY STAT CB EXECUTE TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=-451, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:31.947792] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF017D-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=46, stat_interval=5000000, avg (count/cost)=1548, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:31.949219] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7F-0-0] [lt=24] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:31.949291] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE7F-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:31.961739] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1589, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:31.961804] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8417) [2025-04-21 14:09:31.961849] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=30] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:31.961876] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8417) [2025-04-21 14:09:31.961935] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:31.961955] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1851, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:31.961971] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=128, avg_log_gen_to_submit_time=146, avg_log_submit_to_flush_time=1685, avg_log_submit_to_slide_time=1705) [2025-04-21 14:09:31.962023] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:31.962184] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=53] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215771595752001, v:0}, new_max_version={val:1745215771595752001, v:0}, last_min_version={val:1745215771241946001, v:0}, last_max_version={val:1745215771241946001, v:0}, total_time_us=3753, delta_us=366428) [2025-04-21 14:09:31.962239] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215771595752001, v:0}, min_version={val:1745215771595752001, v:0}, max_version={val:1745215771595752001, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:31.962130] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8417, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:31.966440] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=38] current monitor number(seq_=-1) [2025-04-21 14:09:31.971859] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:31.971921] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:31.975781] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=61] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:31.984893] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F035B-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.985632] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F035C-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:31.989128] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:31.993827] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:32.015505] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215772015499, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2025-04-21 14:09:32.040604] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=43] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:32.041748] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:32.069419] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:32.089208] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.094297] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:32.094370] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=65] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.100652] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8417, avg_group_log_size=601) [2025-04-21 14:09:32.100705] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:32.132152] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2449, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:32.132175] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1954) [2025-04-21 14:09:32.134353] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=96] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:32.146288] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:32.146332] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] try gc retain ctx [2025-04-21 14:09:32.146347] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:32.146395] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215772003323000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215762093995001, v:0}, keep_alive_scn_:{val:1745215767099161001, v:0}, update_ts_:1745215772145658}) [2025-04-21 14:09:32.147413] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=96] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:32.189295] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.194331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:32.199049] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215772100557000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215772198967}, version_delta=98489) [2025-04-21 14:09:32.201391] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=72] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4111, offset=89847}, end_cursor:ObLogCursor{file_id=3, log_id=4112, offset=90153}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7780c050, len:4361, log_data_len:306, seq:4111, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:32.201810] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE80-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:32.201871] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE80-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215771760190003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215771760190003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:32.201932] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215772003323000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198600, in_cluster_service=true, cluster_version={val:1745215771802945000, v:0}, min_cluster_version={val:1745215771802945000, v:0}, max_cluster_version={val:1745215771802945000, v:0}, get_cluster_version_err=0, cluster_version_delta=398978, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1512, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=109732060, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:32.206781] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE80-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215772206624000, start_id=1745215772206624000, end_id=1745215772206624001) [2025-04-21 14:09:32.209600] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=81] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4112, offset=90153}, end_cursor:ObLogCursor{file_id=3, log_id=4113, offset=90450}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77810050, len:4055, log_data_len:297, seq:4112, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:32.209968] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE80-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:32.210035] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE80-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215771760190003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215771760190003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:32.242954] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=28] ts response task statistics(alloc_count=3678, free_count=1838) [2025-04-21 14:09:32.243047] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=73] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=401, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:32.243083] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:32.269556] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=52] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:32.289380] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.319787] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1D-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:32.319851] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1D-0-0] [lt=61] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:32.346502] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=109] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3525) [2025-04-21 14:09:32.360367] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0087-0-0] [lt=39] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:32.368800] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE85-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:32.368868] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE85-0-0] [lt=64] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:32.389457] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.391398] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:32.391496] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=89] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.394870] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:32.400530] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:32.400592] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:32.400768] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:32.400947] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:32.401051] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12262, [delay/us]:prepare:25, schedule:33, submit:10, rt:1322, total:1390) [2025-04-21 14:09:32.401130] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:32.401194] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=56] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12262, [delay/us]: prepare:25, schedule:33, submit:10, device:1322, total:1390) [2025-04-21 14:09:32.401256] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:32.401328] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:748, total:766) [2025-04-21 14:09:32.401407] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:32.401445] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:748, total:766) [2025-04-21 14:09:32.401504] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:32.401540] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:32.405245] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0184-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.407603] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0184-0-0] [lt=31][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254977957910, cache_obj->added_lc()=false, cache_obj->get_object_id()=746, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:32.410480] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:32.410536] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:32.423674] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:09:32.438841] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=64] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:32.440242] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:32.440294] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:32.440316] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:32.440343] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:32.440367] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254976990466, flush_io_finished_ret_:0, flush_io_finished_round_:164, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:32.441794] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:09:32.469696] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:32.472076] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:32.472137] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.474574] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=51] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.474660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.474704] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.476216] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.489546] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.573095] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:32.573162] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=59] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:32.582668] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:32.589629] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.591590] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:32.591670] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=62] temporary file module use no blocks [2025-04-21 14:09:32.591697] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:32.591725] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:32.591752] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254977141822, flush_io_finished_ret_:0, flush_io_finished_round_:164, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:32.594504] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:32.594558] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.595395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:32.602346] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:32.602432] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=40] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:32.602489] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=38] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=33) [2025-04-21 14:09:32.606076] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=60] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:32.607109] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=66][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:32.607151] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:32.608957] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:32.608996] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:32.609144] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=55][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:32.630544] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:32.630624] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:32.633865] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:32.633921] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=45] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:32.633969] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:32.666951] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26438371}, readable_log_tail:{lsn:26438371}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40666397, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:32.667120] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=167] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:32.667174] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=29] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:32.669844] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=61] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:32.689487] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=64] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585000472576, fast_delete_log_mode=false) [2025-04-21 14:09:32.689712] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.695217] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695205] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695418] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=74] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695475] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695671] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695933] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.695988] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.696027] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.696106] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.696188] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=21] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.696250] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:32.697742] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215762694861, end_time=1745215772697737, dag_status={}) [2025-04-21 14:09:32.697808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=60] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697848] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=39] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697887] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697904] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697921] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697938] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697956] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697972] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:32.697989] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698028] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=37] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698047] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698066] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698086] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698105] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698124] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698144] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698163] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698199] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698217] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698235] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698253] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698272] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698307] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698324] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698397] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698432] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698450] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698468] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698485] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698503] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698521] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698538] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698556] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698574] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698609] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698622] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698639] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698711] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698731] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698750] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698786] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698803] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698821] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698839] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698856] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698891] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698922] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698936] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698956] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.698993] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699011] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699047] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699066] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699084] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699102] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699130] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699147] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699165] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699183] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699201] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699219] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699236] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699255] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699273] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:32.699293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:32.699317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:32.699336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:32.699352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:32.699368] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:32.699384] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:32.699399] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:32.699415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:32.699430] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:32.699446] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:32.699463] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:32.701283] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:09:32.710261] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=15] Garbage Collector is running(seq_=17, gc_interval=10000000) [2025-04-21 14:09:32.710371] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=67] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:32.710408] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=25] gc_check_member_list_ cost time(ret=0, time_us=77) [2025-04-21 14:09:32.710440] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=22] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:32.712252] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=32] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:32.712305] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=44] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:32.712335] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=27] execute_gc cost time(ret=0, time_us=33) [2025-04-21 14:09:32.712358] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyHandler start process [2025-04-21 14:09:32.712379] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:32.712411] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:32.722468] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0186-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.725212] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0186-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254978275517, cache_obj->added_lc()=false, cache_obj->get_object_id()=747, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:32.726711] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018A-0-0] [lt=45][errcode=-4201] hashtable not init [2025-04-21 14:09:32.726749] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018A-0-0] [lt=36] get cursor info failed(cursor_id=49, get_sessid()=3221487630) [2025-04-21 14:09:32.726899] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018B-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215772726757000, start_id=1745215772726757000, end_id=1745215772726757001) [2025-04-21 14:09:32.730586] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:32.730644] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:32.730679] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:32.730721] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:32.730765] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:32.730791] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:32.731919] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1550, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:32.731984] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:32.732011] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=82] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:32.732054] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1681, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:32.732074] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:32.740607] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=78] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:32.741437] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE16-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.741446] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F035E-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.743284] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE18-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.743287] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0360-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.743568] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=34] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215772743553], gts:1745215772742988000, latest_srr:[mts=1745215772743553]}) [2025-04-21 14:09:32.751499] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0361-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.753480] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0363-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.760969] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:32.779302] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26438960}], scn_array=[cnt:1, {val:1745215772760258000, v:0}], curr_size=589, accum_size=6594, time_cost=18209) [2025-04-21 14:09:32.789804] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.794859] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:32.795908] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:32.799753] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:32.800970] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:32.801082] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=53] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215768801390000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:32.804436] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:32.804496] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3962, avg_group_log_size=396) [2025-04-21 14:09:32.804544] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:32.806137] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1457, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:32.806176] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3962) [2025-04-21 14:09:32.806217] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:32.806257] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3962) [2025-04-21 14:09:32.806313] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:32.806336] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1592, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:32.806353] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1543, avg_log_submit_to_slide_time=1564) [2025-04-21 14:09:32.806388] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:32.806491] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3962, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:32.815338] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=115] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:32.821180] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16605, max_lsn:26439549, max_scn:{val:1745215772760258000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26439549}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26438960}, last_submit_end_lsn:{lsn:26439549}, last_submit_log_id:16605, last_submit_log_pid:3, max_flushed_lsn:{lsn:26438960}, max_flushed_end_lsn:{lsn:26439549}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26439549}, last_slide_log_id:16605, last_slide_scn:{val:1745215772760258000, v:0}, last_slide_lsn:{lsn:26438960}, last_slide_end_lsn:{lsn:26439549}, last_slide_log_pid:3, last_slide_log_accum_checksum:431759953, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16606, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26439549}, readable_log_tail:{lsn:26439549}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40665219, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:32.821582] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=393] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215772779425, last_flushed_end_lsn:{lsn:26439549}}]) [2025-04-21 14:09:32.821618] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16606, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215772779425, last_flushed_end_lsn:{lsn:26439549}}]) [2025-04-21 14:09:32.828041] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=74] gc stale ls task succ [2025-04-21 14:09:32.832441] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=1643, avg_log_submit_to_slide_time=1662) [2025-04-21 14:09:32.832510] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1964, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:32.838643] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:32.838911] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:32.838961] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:32.838978] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:32.839000] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:32.839018] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254977389148, flush_io_finished_ret_:0, flush_io_finished_round_:164, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:32.843034] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=55] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:32.869973] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:32.889849] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.891626] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:32.891684] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.918306] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=64] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:32.921242] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=49] LogLoopThread round_cost_time(us)(round_cost_time=537) [2025-04-21 14:09:32.926100] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=41] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:32.926470] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0365-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.928297] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0367-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.932725] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:32.932859] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1616, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:32.932899] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:32.932928] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:32.932963] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:32.933028] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:32.933058] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1746, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:32.933079] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1702, avg_log_submit_to_slide_time=1717) [2025-04-21 14:09:32.933109] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:32.939266] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=53] PNIO [ratelimit] time: 1745215772939257, bytes: 5221640, bw: 0.012088 MB/s, add_ts: 1007609, add_bytes: 12772 [2025-04-21 14:09:32.951029] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE80-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:32.951099] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE80-0-0] [lt=66] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:32.962113] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3237, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:32.962162] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7772) [2025-04-21 14:09:32.962284] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=110] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:32.962322] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7772) [2025-04-21 14:09:32.962383] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:32.962407] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3385, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:32.962426] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=3338, avg_log_submit_to_slide_time=3359) [2025-04-21 14:09:32.962468] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:32.962513] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=155] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7772, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:32.962557] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=79] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1002, new_min_version={val:1745215772243158004, v:0}, new_max_version={val:1745215772243158004, v:0}, last_min_version={val:1745215772243158002, v:0}, last_max_version={val:1745215772243158002, v:0}, total_time_us=3333, delta_us=719396) [2025-04-21 14:09:32.962608] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1002, current_version={val:1745215772243158004, v:0}, min_version={val:1745215772243158004, v:0}, max_version={val:1745215772243158004, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:32.964467] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=63] BlockGCTimerTask success(ret=0, cost_time_us=34, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:32.966598] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=47] current monitor number(seq_=-1) [2025-04-21 14:09:32.972248] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:32.972296] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:32.989408] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F036A-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.989928] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:32.990002] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F036B-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:32.996395] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=58] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:33.004457] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] get number(ret=0, service_type_=0, range=1, base_id=1745215773003603000, start_id=1745215773003603000, end_id=1745215773003603001) [2025-04-21 14:09:33.023127] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=66] PNIO [ratelimit] time: 1745215773023120, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007621, add_bytes: 0 [2025-04-21 14:09:33.034299] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=21] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:33.034345] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD95-0-0] [lt=27] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:33.034363] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=61] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:33.034393] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD95-0-0] [lt=44] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:33.041903] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=61] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:33.070146] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=71] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:33.090016] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.094712] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:33.094766] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.101352] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7772, avg_group_log_size=647) [2025-04-21 14:09:33.101403] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:33.133172] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:33.133214] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:33.190104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.196976] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:33.216373] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=81] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4113, offset=90450}, end_cursor:ObLogCursor{file_id=3, log_id=4114, offset=90756}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77814050, len:3758, log_data_len:306, seq:4113, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:33.216821] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE81-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:33.216883] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE81-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215772742988003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215772742988003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:33.223773] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=83] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4114, offset=90756}, end_cursor:ObLogCursor{file_id=3, log_id=4115, offset=91053}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77818050, len:3452, log_data_len:297, seq:4114, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:33.224203] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE81-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:33.224262] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE81-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215772742988003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215772742988003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:33.244091] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=60] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215773244051], gts:1745215773243475000, latest_srr:[mts=1745215773244051]}) [2025-04-21 14:09:33.244170] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=77] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:33.260401] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD5-0-0] [lt=41] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:33.260456] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD5-0-0] [lt=47] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=57) [2025-04-21 14:09:33.275541] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=7900000, replace_num=100000) [2025-04-21 14:09:33.275602] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=58] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:33.290193] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.321917] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1E-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:33.321982] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1E-0-0] [lt=61] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:33.347355] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=62] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3970) [2025-04-21 14:09:33.361255] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F008C-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:33.361529] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] get number(ret=0, service_type_=0, range=1, base_id=1745215773360735000, start_id=1745215773360735000, end_id=1745215773360735001) [2025-04-21 14:09:33.370505] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE86-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:33.370577] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE86-0-0] [lt=68] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:33.390282] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=82][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.391821] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:33.391912] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=78] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.397586] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=84] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:33.402549] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:33.402619] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=48] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:33.402815] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:33.403002] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:33.403082] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:19, schedule:42, submit:9, rt:1376, total:1446) [2025-04-21 14:09:33.403159] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:33.403224] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:19, schedule:42, submit:9, device:1376, total:1446) [2025-04-21 14:09:33.403284] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:33.403355] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:949, total:965) [2025-04-21 14:09:33.403433] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:33.403470] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:949, total:965) [2025-04-21 14:09:33.403529] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:33.403555] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:33.411580] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018C-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.414109] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018C-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254978964413, cache_obj->added_lc()=false, cache_obj->get_object_id()=748, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:33.423759] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:09:33.439001] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:33.440510] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:33.440568] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:33.440596] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:33.440624] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:33.440649] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254977990725, flush_io_finished_ret_:0, flush_io_finished_round_:165, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:33.472467] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:33.472582] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=105] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.475240] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=52] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.475308] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.475300] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.475324] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.475707] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:33.478876] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=65] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:33.490365] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=78][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.569350] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=27] ====== traversal_flush timer task ====== [2025-04-21 14:09:33.569479] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA6-0-0] [lt=58] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215773243475002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:33.569641] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA6-0-0] [lt=124] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:33.569710] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA6-0-0] [lt=65] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:33.582748] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:09:33.590445] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.594912] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:33.594970] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.598093] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=71] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:33.602551] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=62] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:33.605846] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:33.605975] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:09:33.607181] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:33.607224] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:33.608953] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:33.608989] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:33.631437] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:33.631496] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:33.671834] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:33.672965] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=71] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:33.673059] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=90] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:33.673149] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=50] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:33.673264] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=110] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:33.673293] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:33.673321] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215764233919001, v:0}) [2025-04-21 14:09:33.673341] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:33.673366] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:33.673400] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:33.673424] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:33.673457] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:33.673491] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:33.674550] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:33.674594] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=43] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:33.674644] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:33.674732] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=85] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:33.674762] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:33.674791] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:33.674818] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:33.674839] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:33.674864] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:33.674891] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:33.674911] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:33.675845] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:33.690533] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.694675] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.694754] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=25] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695269] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695323] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=59] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695525] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695585] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695594] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695670] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695759] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.695788] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.696009] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=80] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:33.702069] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:09:33.710236] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD8-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:33.723037] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018E-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.724640] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=49] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:33.725596] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF018E-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254979275898, cache_obj->added_lc()=false, cache_obj->get_object_id()=749, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:33.731492] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:33.731563] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:33.731593] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:33.731622] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:33.731668] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:33.731696] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:33.733809] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1639, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:33.733865] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:33.733892] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:33.733931] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1748, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:33.734022] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=84] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:33.742528] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE0D-0-0] [lt=48] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:33.744393] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F036D-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.744726] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F036E-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.746273] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0370-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.746288] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE1A-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.754225] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0371-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.755540] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0373-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.761616] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:33.764155] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA8-0-0] [lt=40] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:33.773697] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE0B-0-0] [lt=24] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:33.790678] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:33.790723] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:33.790740] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.794978] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:33.798626] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:33.805206] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:33.805268] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:33.805307] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:33.806775] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1498, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:33.806822] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:33.806855] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:33.806902] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:33.806974] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:33.807000] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1647, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:33.807019] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1594, avg_log_submit_to_slide_time=1618) [2025-04-21 14:09:33.807054] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=54, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:33.807165] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:33.807296] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:33.807924] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=4600000, clean_num=200000) [2025-04-21 14:09:33.817436] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:33.817479] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:33.828110] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:33.831503] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:33.831545] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] try gc retain ctx [2025-04-21 14:09:33.831560] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:33.831601] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215773243475004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215763732806000, v:0}, keep_alive_scn_:{val:1745215768739412000, v:0}, update_ts_:1745215773831123}) [2025-04-21 14:09:33.832522] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=36] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215780473222000, latest_log_ts:{val:1745215764233919001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:33.832692] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=100] finish update min start scn(max_decided_scn={val:1745215773243475004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215763732806000, v:0}, keep_alive_scn_:{val:1745215768739412000, v:0}, update_ts_:1745215773832193}) [2025-04-21 14:09:33.833644] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215770741042004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:33.835052] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1689, avg_log_submit_to_slide_time=1703) [2025-04-21 14:09:33.835108] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:33.838815] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:33.875993] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:33.879107] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:33.890733] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.892015] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:33.892074] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.909661] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF0-0-0] [lt=33] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:33.915351] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=50] ls blacklist refresh finish(cost_time=8638) [2025-04-21 14:09:33.929443] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0375-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.931140] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0377-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.933195] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1542, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:33.933251] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:33.933276] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:33.933297] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:33.933344] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:33.933365] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1667, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:33.933385] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1617, avg_log_submit_to_slide_time=1636) [2025-04-21 14:09:33.933422] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:33.944649] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:33.946393] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215773946100000, start_id=1745215773946100000, end_id=1745215773946100001) [2025-04-21 14:09:33.946909] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=84] PNIO [ratelimit] time: 1745215773946900, bytes: 5235863, bw: 0.013461 MB/s, add_ts: 1007643, add_bytes: 14223 [2025-04-21 14:09:33.952682] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE81-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:33.952748] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE81-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:33.962906] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1477, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:33.962965] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8318) [2025-04-21 14:09:33.962998] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:33.963032] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8318) [2025-04-21 14:09:33.963089] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:33.963113] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1619, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:33.963132] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1576, avg_log_submit_to_slide_time=1595) [2025-04-21 14:09:33.963166] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:33.965397] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE0F-0-0] [lt=70] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:33.966751] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:09:33.972712] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:33.972766] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:33.990793] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=92][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:33.994051] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F037A-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:33.994901] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F037B-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.007073] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215773804252000, v:0}, new_max_version={val:1745215773804252000, v:0}, last_min_version={val:1745215773604153000, v:0}, last_max_version={val:1745215773604153000, v:0}, total_time_us=3502, delta_us=202818) [2025-04-21 14:09:34.007133] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215773804252000, v:0}, min_version={val:1745215773804252000, v:0}, max_version={val:1745215773804252000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:34.008445] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:34.030748] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215774030738, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:09:34.033768] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:09:34.041989] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=45] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:34.060069] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215773744068000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=315987, in_cluster_service=true, cluster_version={val:1745215773243475004, v:0}, min_cluster_version={val:1745215773243475004, v:0}, max_cluster_version={val:1745215773243475004, v:0}, get_cluster_version_err=0, cluster_version_delta=816580, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1496, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=104935791, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:34.060574] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=18] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=551530496, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=522211328, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:34.060682] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=65] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:34.060719] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=274, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:34.060799] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=662396928, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=411344896, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:34.060872] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:34.060896] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=30, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:34.076119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:34.090865] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.095143] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:34.095194] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.099443] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=16] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:34.099490] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=43] start lib cache evict(tenant_id=1001, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:34.099510] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=154, cache_node_num=154) [2025-04-21 14:09:34.099527] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:34.102004] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8318, avg_group_log_size=639) [2025-04-21 14:09:34.102052] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:34.102649] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=154, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}]) [2025-04-21 14:09:34.103013] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=361] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:34.103610] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8907, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:34.103661] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] get_max_applied_scn(scn={val:1745215774004444000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65941162}, palf_committed_end_scn_:{val:1745215774004444000, v:0}, last_check_scn_:{val:1745215774004444000, v:0}, max_applied_cb_scn_:{val:1745215774004444000, v:0}}) [2025-04-21 14:09:34.103709] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65941162}, readable_log_tail:{lsn:65941162}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1163606, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:34.133203] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=17] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=57, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:34.133265] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=60] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=2230, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:34.133304] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=38] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:34.133339] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=33] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-540, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:34.133368] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=27] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1747, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:34.142948] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:34.190949] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.208964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:34.231359] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=98] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4115, offset=91053}, end_cursor:ObLogCursor{file_id=3, log_id=4116, offset=91359}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7781c050, len:3155, log_data_len:306, seq:4115, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:34.231780] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE82-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:34.231861] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE82-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215773744068003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215773744068003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:34.233014] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:09:34.233163] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:34.235084] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE82-0-0] [lt=14] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215772742988003, v:0}, new_replayable_scn={val:1745215772742988003, v:0}, new_readable_scn={val:1745215772742988003, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215771760190003, replayable_scn:1745215771760190003, readable_scn:1745215771760190003, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:34.237975] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=58] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4116, offset=91359}, end_cursor:ObLogCursor{file_id=3, log_id=4117, offset=91656}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77820050, len:2849, log_data_len:297, seq:4116, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:34.238216] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE82-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:34.238271] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE82-0-0] [lt=36] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215773744068003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215773744068003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:34.245091] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=21] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:34.245347] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=45] submit log success(service_type_=0, last_id=1745215790473222000, limited_id=1745215790473222000) [2025-04-21 14:09:34.245382] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=33] submit log with lock success(service_type_=0, last_id=1745215790473222000, limited_id=1745215790473222000) [2025-04-21 14:09:34.245415] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=413, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:34.246875] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=26] update id meta(ret=0, service_type=0, limited_id=1745215790473222000, latest_scn={val:1745215774245091001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215771760190003, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:34.246995] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=116] handle submit callback(service_type_=0, success=true, used_ts=1647, log_ts={val:1745215774245091001, v:0}, limited_id=1745215790473222000) [2025-04-21 14:09:34.247030] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=34] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:34.247061] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=28] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:34.276267] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:34.291018] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.304017] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=48] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:34.304073] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=55] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=2034, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:34.304089] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:34.304102] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-485, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:34.304121] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1605, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:34.304111] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=26] get_max_applied_scn(scn={val:1745215774161497000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26452696}, palf_committed_end_scn_:{val:1745215774301636000, v:0}, last_check_scn_:{val:1745215774301636000, v:0}, max_applied_cb_scn_:{val:1745215774161497000, v:0}}) [2025-04-21 14:09:34.304164] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26452696}, readable_log_tail:{lsn:26452696}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40652072, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:34.304636] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=47] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:34.323451] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1F-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:34.323498] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE1F-0-0] [lt=43] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:34.348101] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=76] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:34.361806] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0091-0-0] [lt=83] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:34.363478] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=57] get_max_applied_scn(scn={val:1745215774245091001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17404319}, palf_committed_end_scn_:{val:1745215774245091001, v:0}, last_check_scn_:{val:1745215774245091001, v:0}, max_applied_cb_scn_:{val:1745215774245091001, v:0}}) [2025-04-21 14:09:34.363531] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=45] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17404319}, readable_log_tail:{lsn:17404319}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49700449, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:34.372058] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE87-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:34.372120] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE87-0-0] [lt=58] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:34.390982] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=43] clear dtl interm result cost(us)(clear_cost=9, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:34.391085] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.392206] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:34.392259] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.401500] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:34.401560] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=48] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:34.401585] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=34) [2025-04-21 14:09:34.402997] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=18] ====== traversal_flush timer task ====== [2025-04-21 14:09:34.403183] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA7-0-0] [lt=75] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215774361472000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:34.403333] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA7-0-0] [lt=143] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:34.404609] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:34.404670] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:34.404851] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:34.405048] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:34.405131] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:15, schedule:43, submit:8, rt:1163, total:1230) [2025-04-21 14:09:34.405207] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:34.405268] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:15, schedule:43, submit:8, device:1163, total:1230) [2025-04-21 14:09:34.405329] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:34.405405] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:882, total:897) [2025-04-21 14:09:34.405483] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:34.405519] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:882, total:897) [2025-04-21 14:09:34.405579] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:34.405606] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:34.409477] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=68] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:34.410692] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=31] ====== check clog disk timer task ====== [2025-04-21 14:09:34.410738] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=50] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:34.417655] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0190-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.420098] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0190-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254979970404, cache_obj->added_lc()=false, cache_obj->get_object_id()=750, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:34.423827] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=59] gc stale ls task succ [2025-04-21 14:09:34.439175] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=58] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:34.440072] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=36][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:34.440206] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:34.440797] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:34.440848] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:34.440865] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:34.440886] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:34.440909] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254978991014, flush_io_finished_ret_:0, flush_io_finished_round_:166, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:34.441816] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215774440238) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215774440238) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:34.443365] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=83] ====== tenant freeze timer task ====== [2025-04-21 14:09:34.449776] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:34.450011] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:34.450738] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:34.450795] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=56] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:34.450860] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=30] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:34.450962] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=97] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:34.451005] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:34.451029] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215771299107001, v:0}) [2025-04-21 14:09:34.451048] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:34.451067] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:34.451084] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:34.451112] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:34.451130] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:34.451156] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:34.451185] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=27] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:34.451204] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:34.451265] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:34.451371] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215771218295000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:34.460437] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=94] get_max_applied_scn(scn={val:1745215774245091000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9180040}, palf_committed_end_scn_:{val:1745215774245091001, v:0}, last_check_scn_:{val:1745215774245091001, v:0}, max_applied_cb_scn_:{val:1745215774245091000, v:0}}) [2025-04-21 14:09:34.460487] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=45] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9180040}, readable_log_tail:{lsn:9180040}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57924728, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:34.472858] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:34.472906] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.474718] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.474782] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.475370] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.475429] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.476416] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:34.491162] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.552400] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=90] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:34.573262] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=23] ====== check clog disk timer task ====== [2025-04-21 14:09:34.573313] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=43] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:34.582834] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=48] gc stale ls task succ [2025-04-21 14:09:34.591240] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.592002] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:34.592068] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=58] temporary file module use no blocks [2025-04-21 14:09:34.592094] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:34.592122] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:34.592147] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254979142218, flush_io_finished_ret_:0, flush_io_finished_round_:166, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:34.595316] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:34.595377] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.602726] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:34.607233] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:34.607273] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:34.609082] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:34.609118] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:34.609964] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=42] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:34.623108] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=48] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:34.632233] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:34.632300] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:34.635488] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2025-04-21 14:09:34.635539] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61896280, tenant_id=1002) [2025-04-21 14:09:34.635578] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:34.655338] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=26] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:34.655400] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=47] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=32) [2025-04-21 14:09:34.655500] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:34.655546] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=45] try gc retain ctx [2025-04-21 14:09:34.655567] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=20] try to retry start_working [2025-04-21 14:09:34.655622] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215774561381000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215764553759001, v:0}, keep_alive_scn_:{val:1745215769557463001, v:0}, update_ts_:1745215774654837}) [2025-04-21 14:09:34.656100] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:34.656156] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:34.656179] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:34.656198] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=32) [2025-04-21 14:09:34.656575] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=30] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:34.676549] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:34.680138] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:34.681399] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=60] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:34.681496] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215765605373000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:34.690655] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=31] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:34.690728] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=56] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=34) [2025-04-21 14:09:34.691325] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.694087] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=36] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:34.694139] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=40] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:34.694167] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=25] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=34) [2025-04-21 14:09:34.694739] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.694904] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695022] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695071] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695217] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695410] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695709] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=96] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.695840] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.696028] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=26] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.696044] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.696104] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:34.702600] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8432) [2025-04-21 14:09:34.732272] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:34.732370] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=79] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:09:34.732404] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:34.732433] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:34.732476] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:34.732498] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:34.733989] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1416, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:34.734041] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:34.734055] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:34.734093] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1526, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:34.734114] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:34.745698] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=412, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:34.745914] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215774745898], gts:1745215774745097000, latest_srr:[mts=1745215774745898]}) [2025-04-21 14:09:34.747449] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F037D-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.747449] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE1B-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.749473] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F037F-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.749491] WDIAG begin (ob_hashtable.h:954) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFE4C-0-0] [lt=25][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.756378] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0380-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.757953] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0382-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.762352] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=95] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:34.791413] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.795099] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:34.806223] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=95] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:34.806283] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3535, avg_group_log_size=353) [2025-04-21 14:09:34.806324] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:34.807843] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1371, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:34.807889] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3535) [2025-04-21 14:09:34.807926] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:34.807955] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3535) [2025-04-21 14:09:34.808015] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:34.808040] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1518, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:34.808059] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1471, avg_log_submit_to_slide_time=1491) [2025-04-21 14:09:34.808092] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:34.808195] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3535, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:34.810454] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:34.825506] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=70] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:34.828193] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:34.838983] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:34.839234] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:34.839286] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:34.839328] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:34.839370] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=38] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:34.839403] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=32] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254979389455, flush_io_finished_ret_:0, flush_io_finished_round_:166, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:34.860384] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=49] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:34.876695] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:34.891496] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.892378] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:34.892446] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=58] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.913660] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=47] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:34.919807] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=41] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:34.932290] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0384-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.933947] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1507, avg_log_submit_to_slide_time=1526) [2025-04-21 14:09:34.934016] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0386-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.934032] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1485, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:34.934068] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=168, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:34.934062] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1342, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:34.934103] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:34.934123] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1731, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:34.934141] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=33, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:34.935536] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:34.935579] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=39] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:34.935599] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:34.935621] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:34.938852] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:34.939567] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=712] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:34.954432] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE82-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:34.954495] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE82-0-0] [lt=60] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:34.954488] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=83] PNIO [ratelimit] time: 1745215774954484, bytes: 5248635, bw: 0.012089 MB/s, add_ts: 1007584, add_bytes: 12772 [2025-04-21 14:09:34.963656] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1367, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:34.963703] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7884) [2025-04-21 14:09:34.963747] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:34.963786] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7884) [2025-04-21 14:09:34.963840] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:34.963863] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1500, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:34.963882] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1461, avg_log_submit_to_slide_time=1479) [2025-04-21 14:09:34.963920] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:34.973031] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:34.973082] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:34.991575] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:34.998449] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0389-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:34.999038] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F038A-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.007825] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215774805231000, v:0}, new_max_version={val:1745215774805231000, v:0}, last_min_version={val:1745215774605315000, v:0}, last_max_version={val:1745215774605315000, v:0}, total_time_us=3369, delta_us=202591) [2025-04-21 14:09:35.007885] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215774805231000, v:0}, min_version={val:1745215774805231000, v:0}, max_version={val:1745215774805231000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:35.007916] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:35.011049] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:35.033886] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1348) [2025-04-21 14:09:35.033948] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1665, avg_log_submit_to_slide_time=1681) [2025-04-21 14:09:35.033914] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:35.035116] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=28] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:35.035155] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=38] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:35.035153] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD96-0-0] [lt=28] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:35.035200] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD96-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:35.035234] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=61] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:35.038337] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=116] PNIO [ratelimit] time: 1745215775038333, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007595, add_bytes: 0 [2025-04-21 14:09:35.042152] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=63] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:35.076839] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:35.091776] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.095473] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:35.095522] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.099238] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=78] LogLoopThread round_cost_time(us)(round_cost_time=19) [2025-04-21 14:09:35.102787] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=242] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7884, avg_group_log_size=606) [2025-04-21 14:09:35.102838] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:35.104526] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7884, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:35.111085] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=49][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:35.116818] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=101] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:35.134009] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=36] [APPLY STAT CB APPEND COST TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=28, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:35.134012] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1348) [2025-04-21 14:09:35.134050] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=40] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=1640, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:35.134066] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:35.134079] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=-685, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:35.134093] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0353-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=24, stat_interval=5000000, avg (count/cost)=982, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:35.191844] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.211737] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:35.234119] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:35.234154] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1226, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:35.243838] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4117, offset=91656}, end_cursor:ObLogCursor{file_id=3, log_id=4118, offset=91962}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77824050, len:2552, log_data_len:306, seq:4117, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:35.244159] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE83-0-0] [lt=28] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:35.244241] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE83-0-0] [lt=57] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215774745097003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215774745097003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:35.246169] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=30] ts response task statistics(alloc_count=3750, free_count=1874) [2025-04-21 14:09:35.246221] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:35.250261] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4118, offset=91962}, end_cursor:ObLogCursor{file_id=3, log_id=4119, offset=92259}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77828050, len:2246, log_data_len:297, seq:4118, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:35.250557] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE83-0-0] [lt=51] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:35.250626] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE83-0-0] [lt=50] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215774745097003, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215774745097003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:35.260052] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE6-0-0] [lt=63] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.260986] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD6-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:35.261054] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD6-0-0] [lt=60] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=70) [2025-04-21 14:09:35.262778] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=46] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:35.262893] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=114] check all tenants(ret=0) [2025-04-21 14:09:35.264164] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDE9-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.265465] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDEA-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.266758] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDEB-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.268050] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDEC-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.269373] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDED-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.270649] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDEE-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.271929] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDEF-0-0] [lt=42] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.276990] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:35.291914] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.301397] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215775102578000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198808, in_cluster_service=true, cluster_version={val:1745215774901999000, v:0}, min_cluster_version={val:1745215774901999000, v:0}, max_cluster_version={val:1745215774901999000, v:0}, get_cluster_version_err=0, cluster_version_delta=399387, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1508, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=110121979, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:35.324983] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE20-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:35.325046] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE20-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:35.348926] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:35.362713] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F0096-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:35.373795] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE88-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:35.373869] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE88-0-0] [lt=70] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.375507] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] success to update min reserved snapshot(reserved_snapshot=1745213965605373000, duration=1800, snapshot_gc_ts=1745215765605373000) [2025-04-21 14:09:35.375574] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] success to update min reserved snapshot(reserved_snapshot=1745213968801390000, duration=1800, snapshot_gc_ts=1745215768801390000) [2025-04-21 14:09:35.377107] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] update reserved snapshot finished(cost_ts=1605, reserved_snapshot=1745213965605373000) [2025-04-21 14:09:35.377199] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213968801390000) [2025-04-21 14:09:35.377240] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] update reserved snapshot finished(cost_ts=1673, reserved_snapshot=1745213968801390000) [2025-04-21 14:09:35.391981] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.392560] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:35.392613] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.402473] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:35.403738] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDA8-0-0] [lt=41] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:35.404229] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1745215775403535000, start_id=1745215775403535000, end_id=1745215775403535001) [2025-04-21 14:09:35.405840] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65949734, this={dio_aligned_buf:{buf_write_offset:583, buf_padding_size:3513, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4273, truncate_used_ts:1774}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65949696, buf_len=545, total_write_size=38269, total_write_size_after_dio=471040, ob_pwrite_used_ts=164640, count=105, each_pwrite_cost=1568) [2025-04-21 14:09:35.406900] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:35.406962] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:35.407135] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:35.407307] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:35.407391] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:17, schedule:35, submit:8, rt:1147, total:1207) [2025-04-21 14:09:35.407477] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:35.407553] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=66] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:17, schedule:35, submit:8, device:1147, total:1207) [2025-04-21 14:09:35.407615] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:35.407682] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:673, total:687) [2025-04-21 14:09:35.407752] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:35.407800] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:673, total:687) [2025-04-21 14:09:35.407854] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:35.407875] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:35.412225] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:35.423923] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:35.424178] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0192-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.426774] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0192-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254980977081, cache_obj->added_lc()=false, cache_obj->get_object_id()=751, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:35.439324] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:35.441035] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:35.441089] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:35.441107] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:35.441126] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:35.441145] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254979991267, flush_io_finished_ret_:0, flush_io_finished_round_:167, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:35.473263] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:35.473346] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=72] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.475091] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.475162] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.475458] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.475524] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.482073] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=55] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8000000, replace_num=100000) [2025-04-21 14:09:35.482119] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:35.488208] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=64] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:35.492070] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.565700] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=62] get wrs ts(ls_id={id:1}, delta=319173, log_service_ts=1745215775246172, min_tx_service_ts=4611686018427387, timestamp={val:1745215775246172001, v:0}) [2025-04-21 14:09:35.565773] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=66] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1002, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=5, Other_Error_Cnt=0, Submit_Succ_Cnt=95, last_scn="{val:1745215773744068000, v:0}", last_lsn={lsn:17403646}, last_gts={val:1745215775246172000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:35.582913] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:09:35.592112] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.592284] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:35.592347] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:35.592365] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:35.592391] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:35.592416] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254980142508, flush_io_finished_ret_:0, flush_io_finished_round_:167, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:35.595641] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=6239232) [2025-04-21 14:09:35.595692] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.602897] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:35.607419] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:35.607458] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:35.609261] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:35.609301] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:35.612703] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:35.632882] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:35.632932] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:35.682228] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:35.692180] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.694554] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.694904] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695053] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695248] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695277] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=28] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695337] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695863] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.695922] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.696106] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.696108] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.696159] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:35.703548] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=67] get number(ret=0, service_type_=0, range=1, base_id=1745215775703486000, start_id=1745215775703486000, end_id=1745215775703486001) [2025-04-21 14:09:35.703675] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7881) [2025-04-21 14:09:35.709892] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=24] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17405905}, readable_log_tail:{lsn:17405905}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49698863, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:35.710071] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=175] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:35.710107] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=29] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9181504}, readable_log_tail:{lsn:9181504}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57923264, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:35.710212] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=103] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:35.710261] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=20] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:35.715600] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDD9-0-0] [lt=35] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:35.732939] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:35.732998] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:35.733054] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:35.733085] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:35.733125] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:35.733150] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:35.734905] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1393, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:35.734964] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:35.735016] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:35.735051] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1502, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:35.735077] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:35.746673] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=26] get number(ret=0, service_type_=0, range=1, base_id=1745215775745867000, start_id=1745215775745867000, end_id=1745215775745867001) [2025-04-21 14:09:35.746749] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=70] handle gts request statistics(total_rt=477, total_cnt=60, avg_rt=7.819672131147540561e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:35.746825] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=36] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215775746805], gts:1745215775745867000, latest_srr:[mts=1745215775746805]}) [2025-04-21 14:09:35.750740] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F038C-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.751095] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F038D-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.752547] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F038F-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.752590] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE1E-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.755440] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=29] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:35.755487] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=43] finish to resize log external storage handler(current_ts=1745215775755483, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:35.758757] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0390-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.760175] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0392-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.761451] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA7-0-0] [lt=26] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:35.761503] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA7-0-0] [lt=43] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:35.762888] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] Garbage Collector is running(seq_=17, gc_interval=10000000) [2025-04-21 14:09:35.762964] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:35.762990] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:35.763016] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_check_member_list_ cost time(ret=0, time_us=87) [2025-04-21 14:09:35.763042] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:35.763083] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:35.764374] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:35.765647] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:35.765691] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=36] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:35.765716] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:35.765736] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=48) [2025-04-21 14:09:35.765755] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyHandler start process [2025-04-21 14:09:35.788938] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=59] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:35.792263] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.795228] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:35.806089] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=19] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:35.806639] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:35.806712] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=5518, avg_group_log_size=394) [2025-04-21 14:09:35.806748] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:35.807302] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=45] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:35.807397] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215768801390000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:35.808393] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1314, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:35.808433] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=5518) [2025-04-21 14:09:35.808485] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:35.808526] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5518) [2025-04-21 14:09:35.808583] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:35.808606] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1433, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:35.808624] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1392, avg_log_submit_to_slide_time=1411) [2025-04-21 14:09:35.808656] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:35.808755] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=5518, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:35.813220] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:35.817598] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=17] ====== check clog disk timer task ====== [2025-04-21 14:09:35.817655] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=48] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:35.822345] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=4800000, clean_num=200000) [2025-04-21 14:09:35.828258] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=50] gc stale ls task succ [2025-04-21 14:09:35.839151] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:35.839533] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=51] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:35.839581] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:35.839598] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:35.839623] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:35.839649] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254980389771, flush_io_finished_ret_:0, flush_io_finished_round_:167, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:35.880704] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:09:35.882371] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:35.888652] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10619, max_lsn:17406149, max_scn:{val:1745215775746950000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17406149}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17406027}, last_submit_end_lsn:{lsn:17406149}, last_submit_log_id:10619, last_submit_log_pid:3, max_flushed_lsn:{lsn:17406027}, max_flushed_end_lsn:{lsn:17406149}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17406149}, last_slide_log_id:10619, last_slide_scn:{val:1745215775746950000, v:0}, last_slide_lsn:{lsn:17406027}, last_slide_end_lsn:{lsn:17406149}, last_slide_log_pid:3, last_slide_log_accum_checksum:641601592, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10620, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17406149}, readable_log_tail:{lsn:17406149}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49698619, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:35.888927] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=266] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215775834797, last_flushed_end_lsn:{lsn:17406149}}]) [2025-04-21 14:09:35.888954] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10620, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215775834797, last_flushed_end_lsn:{lsn:17406149}}]) [2025-04-21 14:09:35.889039] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14771, max_lsn:9181748, max_scn:{val:1745215775746950000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:9181748}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:9181626}, last_submit_end_lsn:{lsn:9181748}, last_submit_log_id:14771, last_submit_log_pid:3, max_flushed_lsn:{lsn:9181626}, max_flushed_end_lsn:{lsn:9181748}, max_flushed_log_pid:3, committed_end_lsn:{lsn:9181748}, last_slide_log_id:14771, last_slide_scn:{val:1745215775746950000, v:0}, last_slide_lsn:{lsn:9181626}, last_slide_end_lsn:{lsn:9181748}, last_slide_log_pid:3, last_slide_log_accum_checksum:3605511682, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14772, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:9181748}, readable_log_tail:{lsn:9181748}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57923020, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:35.889295] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=252] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215775834637, last_flushed_end_lsn:{lsn:9181748}}]) [2025-04-21 14:09:35.889322] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=25] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14772, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215775834637, last_flushed_end_lsn:{lsn:9181748}}]) [2025-04-21 14:09:35.892348] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:35.892736] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:35.892789] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.902671] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=85] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:35.926240] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=40] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:35.935048] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=1521, avg_log_submit_to_slide_time=1539) [2025-04-21 14:09:35.935146] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:35.935232] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0394-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.935260] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1547, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:35.935368] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=101] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:35.935411] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:35.935435] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1673, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:35.935453] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:35.937061] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0396-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:35.956259] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE83-0-0] [lt=18] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:35.956339] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE83-0-0] [lt=77] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:35.962122] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215775962116, bytes: 5262858, bw: 0.013461 MB/s, add_ts: 1007632, add_bytes: 14223 [2025-04-21 14:09:35.964732] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1379, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:35.964781] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7883) [2025-04-21 14:09:35.964827] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:35.964883] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7883) [2025-04-21 14:09:35.964948] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:35.964973] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1515, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:35.964994] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1474, avg_log_submit_to_slide_time=1493) [2025-04-21 14:09:35.965050] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:35.967001] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=42] current monitor number(seq_=-1) [2025-04-21 14:09:35.973444] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:35.973492] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:35.988714] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=35] LogLoopThread round_cost_time(us)(round_cost_time=733) [2025-04-21 14:09:35.992420] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.003064] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0399-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.003705] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F039A-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.009290] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215775806050000, v:0}, new_max_version={val:1745215775806050000, v:0}, last_min_version={val:1745215775606233000, v:0}, last_max_version={val:1745215775606233000, v:0}, total_time_us=3965, delta_us=203237) [2025-04-21 14:09:36.009351] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=58] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215775806050000, v:0}, min_version={val:1745215775806050000, v:0}, max_version={val:1745215775806050000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:36.022866] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43584241664, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:36.034548] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=19, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}, log_alloc_mgr_:{flying_log_task:2, flying_meta_task:0}}) [2025-04-21 14:09:36.034675] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:36.034938] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:36.034978] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1664, avg_log_submit_to_slide_time=1676) [2025-04-21 14:09:36.042279] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=44] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:36.045950] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215776045946, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2025-04-21 14:09:36.082511] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:36.092487] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.095805] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=6239232) [2025-04-21 14:09:36.095856] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.103556] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7883, avg_group_log_size=606) [2025-04-21 14:09:36.103602] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:36.105258] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7883, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:36.148704] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=25] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:36.148750] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=41] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:36.148777] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=23] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=151, cache_node_num=150) [2025-04-21 14:09:36.148806] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=27] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:36.151057] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=82] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:161, free_obj_hold_cnt:0, allocator used:329728, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:36.152039] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=151, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}]) [2025-04-21 14:09:36.152392] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=348] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:36.192549] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=68][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.208476] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:36.223300] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43582144512, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:36.234560] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:36.234715] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:36.234737] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:36.240941] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF0-0-0] [lt=27] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:36.247349] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215776247316], gts:1745215776246439000, latest_srr:[mts=1745215776247316]}) [2025-04-21 14:09:36.247397] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=46] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:36.256172] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4119, offset=92259}, end_cursor:ObLogCursor{file_id=3, log_id=4120, offset=92565}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7782c050, len:1949, log_data_len:306, seq:4119, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:36.256522] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE84-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:36.256616] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE84-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215775746950003, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215775746950003, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:36.259692] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE84-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215776259338000, start_id=1745215776259338000, end_id=1745215776259338001) [2025-04-21 14:09:36.262110] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=48] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4120, offset=92565}, end_cursor:ObLogCursor{file_id=3, log_id=4121, offset=92862}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77830050, len:1643, log_data_len:297, seq:4120, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:36.262386] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE84-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:36.262456] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE84-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215775746950004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215775746950004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:36.282648] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:36.292617] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.303502] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0091-0-0] [lt=19] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=92) [2025-04-21 14:09:36.326471] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE21-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:36.326511] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE21-0-0] [lt=38] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:36.349695] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5518) [2025-04-21 14:09:36.363293] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F009B-0-0] [lt=43] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.989038658142089844e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=399, Throttle Trigger(MB)=239, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.896196308457185751e+02) [2025-04-21 14:09:36.375214] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=17] job is running now, retry later(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:36.378748] WDIAG begin (ob_hashtable.h:954) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=112][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7af65f8 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0x76fbe1d 0x76fb83f 0x1ee36634 0xec1e3b6 0xec24d59 0xec47a47 0xbfbea7f 0x1ec7df64 0x1ec847dc 0x1ec83fb8 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.386373] INFO [COMMON] handle (ob_io_struct.cpp:2969) [620264][T1002_DiskCB0][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=87] callback runner call handle(get_queue_count()=0, req={is_inited_:true, tenant_id_:1002, control_block_:0x7f3c91abe4c0, ref_cnt_:1, raw_buf_:0x7f3c03748150, fd_:{first_id:1152921504606849042, second_id:2067, third_id:0, fd_id:-1, slot_version:-1, device_handle:0x7f3c91a4a080}, trace_id_:YB420B1D7AB6-00063343B54EFE89-0-0, retry_count_:0, tenant_io_mgr_:{ptr:0x7f3c3afe6030}, storage_accesser:{ptr:null}, io_result_:{is_inited_:true, is_finished_:false, is_canceled_:false, has_estimated_:false, complete_size_:4096, offset_:1880700, size_:293, timeout_us_:10000000, result_ref_cnt_:2, out_ref_cnt_:1, flag_:{mode:"READ", group_id_:0, func_type_:0, wait_event_id_:1, is_sync_:false, is_unlimited_:false, is_detect_:false, is_write_through_:false, is_sealed_:true, is_time_detect_:false, need_close_dev_and_fd_:false, reserved_:0}, ret_code_:{io_ret_:0, fs_errno_:0}, tenant_id_:1002, tenant_io_mgr_:{ptr:0x7f3c3afe6030}, user_data_buf_:null, buf_:null, io_callback_:0x7f3bc7fec080, time_log:{begin_ts:1745215776385667, enqueue_used:7, dequeue_used:32, submit_used:15, return_used:609, callback_enqueue_used:5, callback_dequeue_used:32, callback_finish_used:-1, end_used:-1}}, part_id:-1}) [2025-04-21 14:09:36.387169] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=37] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1}, tablet_id={id:519}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:36.387246] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=44] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:519}) [2025-04-21 14:09:36.387276] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=25] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:519}, max_saved_version=0) [2025-04-21 14:09:36.387298] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=21] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:519}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.387336] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=22] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c213ad0e0, key:{tablet_id:{id:519}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776387330}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776387330, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c2486c390, memtable_mgr_handle_:{memtable_mgr:0x7f3c21364fc0, pool:0x7f3c385d4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c213ad0e0, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c39c5e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3c21364fc0, ref_cnt:2, is_inited:true, tablet_id:{id:519}, freezer:0x7f3c2486c390, memtable_head:0, memtable_tail:1, t3m:0x7f3c3aedc030, tables:[0x7f3c213ad0e0, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c248670d0}, ls_id:{id:1}, tablet_id:{id:519}}}) [2025-04-21 14:09:36.387467] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=127] succeeded to create memtable for tablet(ret=0, tablet_id={id:519}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.387500] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=25] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:519}, table_store_addr={ptr:0x7f3c19a83aa0, addr:{[ver=1,mode=0,seq=2320][2nd=2321][3rd=0][offset=1683456,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c19a83460) [2025-04-21 14:09:36.387642] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=25][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:36.387674] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=27] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1}, tablet_id={id:101105}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:36.387710] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=20] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:101105}) [2025-04-21 14:09:36.387731] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=18] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:101105}, max_saved_version=0) [2025-04-21 14:09:36.387750] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=18] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:101105}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.387774] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=18] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c213ad8f0, key:{tablet_id:{id:101105}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776387772}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776387772, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c2486c390, memtable_mgr_handle_:{memtable_mgr:0x7f3c213651b0, pool:0x7f3c385d4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c213ad8f0, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c39c5e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3c213651b0, ref_cnt:2, is_inited:true, tablet_id:{id:101105}, freezer:0x7f3c2486c390, memtable_head:0, memtable_tail:1, t3m:0x7f3c3aedc030, tables:[0x7f3c213ad8f0, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c248670d0}, ls_id:{id:1}, tablet_id:{id:101105}}}) [2025-04-21 14:09:36.387836] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=60] succeeded to create memtable for tablet(ret=0, tablet_id={id:101105}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.387859] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=20] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:101105}, table_store_addr={ptr:0x7f3c397d89c0, addr:{[ver=1,mode=0,seq=2320][2nd=2321][3rd=0][offset=446464,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c397d8380) [2025-04-21 14:09:36.387932] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=21] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:101106}) [2025-04-21 14:09:36.387953] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=19] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:101106}, max_saved_version=0) [2025-04-21 14:09:36.387971] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=16] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:101106}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.387993] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=18] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c213ae100, key:{tablet_id:{id:101106}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776387991}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776387991, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c2486c390, memtable_mgr_handle_:{memtable_mgr:0x7f3c213653a0, pool:0x7f3c385d4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c213ae100, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c39c5e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3c213653a0, ref_cnt:2, is_inited:true, tablet_id:{id:101106}, freezer:0x7f3c2486c390, memtable_head:0, memtable_tail:1, t3m:0x7f3c3aedc030, tables:[0x7f3c213ae100, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c248670d0}, ls_id:{id:1}, tablet_id:{id:101106}}}) [2025-04-21 14:09:36.388051] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=56] succeeded to create memtable for tablet(ret=0, tablet_id={id:101106}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.388068] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=14] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:101106}, table_store_addr={ptr:0x7f3c397610e4, addr:{[ver=1,mode=0,seq=2060][2nd=2061][3rd=0][offset=1462272,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c39760a80) [2025-04-21 14:09:36.388285] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215776388100000, start_id=1745215776388100000, end_id=1745215776388100001) [2025-04-21 14:09:36.389808] WDIAG [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:263) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=27][errcode=0] job is timeout, force update for end(job_info={tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176239399, start_date_:1745214971149911, last_date_:0, this_date_:1745215176239399, next_date_:1745215871149911, end_date_:64060560000000000, total_:600135930, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, now=1745215776375211) [2025-04-21 14:09:36.389858] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE89-0-0] [lt=47] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:36.392684] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.392883] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:36.392933] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.408837] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:36.408892] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:36.409085] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:36.409253] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:36.409327] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:14, schedule:31, submit:7, rt:1101, total:1154) [2025-04-21 14:09:36.409371] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:ROOT_BLOCK_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:5, schedule:25, submit:11, rt:543, total:585) [2025-04-21 14:09:36.409412] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:36.409462] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:5, schedule:25, submit:11, device:543, total:585) [2025-04-21 14:09:36.409477] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:14, schedule:31, submit:7, device:1101, total:1154) [2025-04-21 14:09:36.409531] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:36.409594] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:509, total:524) [2025-04-21 14:09:36.409663] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:36.409693] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:509, total:524) [2025-04-21 14:09:36.409746] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:36.409766] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:36.410867] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:36.410908] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:36.423776] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43582144512, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:36.424004] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=51] gc stale ls task succ [2025-04-21 14:09:36.430246] WDIAG begin (ob_hashtable.h:954) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD89-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.432538] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD89-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254981982811, cache_obj->added_lc()=false, cache_obj->get_object_id()=752, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:36.439482] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:36.444891] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=59] ====== tenant freeze timer task ====== [2025-04-21 14:09:36.473607] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:36.473656] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.475114] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.475545] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.475611] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.476237] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.482785] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:36.492757] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.573439] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:36.573498] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=50] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:36.582990] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=41] gc stale ls task succ [2025-04-21 14:09:36.592537] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:36.592600] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=53] temporary file module use no blocks [2025-04-21 14:09:36.592618] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:36.592648] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:36.592668] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254981142773, flush_io_finished_ret_:0, flush_io_finished_round_:168, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:36.592834] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=74][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.595979] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:36.596031] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.600716] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:36.602380] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215776601965000, start_id=1745215776601965000, end_id=1745215776601965001) [2025-04-21 14:09:36.603056] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:36.608109] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:36.608152] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:36.610070] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:36.610108] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:36.624268] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43582144512, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:36.633600] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:36.633654] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:36.637085] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] ====== tenant freeze timer task ====== [2025-04-21 14:09:36.637130] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:36.637167] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:36.682917] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:36.690885] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] [COMPACTION DAG STATUS] (start_time=1745215766687422, end_time=1745215776690882, dag_status={}) [2025-04-21 14:09:36.690928] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=39] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.690948] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.690966] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.690985] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691002] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691019] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691036] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691048] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691065] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:36.691082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691104] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691122] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691158] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691176] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691229] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691264] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691299] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691370] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691387] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691405] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691423] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691440] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691475] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691510] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691527] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691545] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691562] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691580] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691597] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691624] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691642] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691659] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691677] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691695] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691712] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691730] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691747] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691765] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691782] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691826] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691844] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691879] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691896] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.691984] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692002] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692019] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692036] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692054] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692071] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692106] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692123] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692140] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692158] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692197] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692215] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692254] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692288] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692302] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692316] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:36.692336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:36.692353] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:36.692370] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:36.692385] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:36.692401] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:36.692415] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:36.692430] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:36.692445] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:36.692460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:36.692474] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:36.692490] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:36.692903] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=96][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.694413] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.694715] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=17] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695356] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695625] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695693] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695711] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695895] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.695960] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.696002] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.696181] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.696338] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:36.704197] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:09:36.731968] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0195-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.733679] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:36.733729] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3405, avg_group_log_size=340) [2025-04-21 14:09:36.733762] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3405) [2025-04-21 14:09:36.733781] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:36.733814] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:36.733837] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:36.734270] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0195-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254982284577, cache_obj->added_lc()=false, cache_obj->get_object_id()=753, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:36.735139] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=138] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1367, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:36.735189] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:36.735225] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:36.735247] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1479, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:36.735268] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:36.735605] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0199-0-0] [lt=37][errcode=-4201] hashtable not init [2025-04-21 14:09:36.735639] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0199-0-0] [lt=33] get cursor info failed(cursor_id=50, get_sessid()=3221487630) [2025-04-21 14:09:36.735764] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215776734705000, start_id=1745215776734705000, end_id=1745215776734705001) [2025-04-21 14:09:36.745203] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE0F-0-0] [lt=38] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:36.753484] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE1F-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.753491] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F039B-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.755278] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F039D-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.755285] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE21-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.760859] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F039E-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.762010] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03A0-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.763929] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:36.764539] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03A2-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.765734] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=60][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:36.767286] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=32] get number(ret=0, service_type_=0, range=1, base_id=1745215776766703000, start_id=1745215776766703000, end_id=1745215776766703001) [2025-04-21 14:09:36.769112] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03A6-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.776270] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE0D-0-0] [lt=39] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:36.793037] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=66] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:36.793066] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=27] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:36.793084] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.795336] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=38] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:36.799168] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [619974][T1_ObXAHbWorker][T1][Y0-0000000000000000-0-0] [lt=42] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:36.805965] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215776607306000, v:0}, base_version={val:1745215776406212000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215776607306000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215776805944, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:36.807605] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:36.807656] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3971, avg_group_log_size=397) [2025-04-21 14:09:36.807683] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:36.808854] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1246, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:36.808898] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3971) [2025-04-21 14:09:36.808933] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=28, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:36.808959] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3971) [2025-04-21 14:09:36.809025] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:36.809050] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1361, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:36.809068] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1321, avg_log_submit_to_slide_time=1340) [2025-04-21 14:09:36.809099] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:36.809221] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3971, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:36.812656] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=17] ====== traversal_flush timer task ====== [2025-04-21 14:09:36.812751] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA8-0-0] [lt=39] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:36.812861] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA8-0-0] [lt=105] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:36.824774] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43582144512, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:36.828326] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:36.833508] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=111] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:54, free_obj_hold_cnt:0, allocator used:110592, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:36.839303] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:36.855977] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:36.856906] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=35] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:36.856960] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=52] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:36.857034] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:36.857125] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=87] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:36.857276] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=143] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:36.857303] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215768600374001, v:0}) [2025-04-21 14:09:36.857324] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:36.857338] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=11] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:36.857361] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:36.857391] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:36.857412] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:36.857441] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:36.857471] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:36.857492] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:36.877356] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=61] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}) [2025-04-21 14:09:36.883052] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:36.893036] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:36.893040] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:36.893083] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=36] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.909471] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF2-0-0] [lt=48] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:36.914634] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] start to print blacklist info [2025-04-21 14:09:36.914796] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=36] ls blacklist refresh finish(cost_time=7949) [2025-04-21 14:09:36.930420] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=38] runTimer to refresh locality_info(ret=0) [2025-04-21 14:09:36.932119] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=30] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:09:36.932178] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=48] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:09:36.932202] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=22] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:09:36.932229] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=23] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:09:36.932245] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:09:36.932267] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:09:36.932283] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:09:36.932302] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:09:36.938200] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03A8-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.939664] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03AA-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.944640] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD95-0-0] [lt=24] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215772038913, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:36.944694] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD95-0-0] [lt=52] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215772040737, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:36.944716] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD95-0-0] [lt=20] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215772042090, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215772042086, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:36.951613] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=11] [APPLY STAT CB APPEND COST TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:36.951649] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=35] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=1526, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:36.951663] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=13] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:36.951676] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=11] [APPLY STAT CB EXECUTE TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=-451, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:36.951693] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=49, stat_interval=5000000, avg (count/cost)=1131, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:36.957737] INFO [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:258) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=22] job is running now, retry later(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:0, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:0, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}) [2025-04-21 14:09:36.961063] WDIAG begin (ob_hashtable.h:954) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af677d 0x7af65f8 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x77d218d 0x77cd71a 0x77cb868 0x76fbe1d 0x76fb83f 0x1ee36634 0xec1e3b6 0xec24d59 0xec47a47 0xbfbea7f 0x1ec7df64 0x1ec847dc 0x1ec83fb8 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:36.965183] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1248, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:36.965226] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7774) [2025-04-21 14:09:36.965259] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:36.965301] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:09:36.965357] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:36.965381] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1372, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:36.965399] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=1337, avg_log_submit_to_slide_time=1353) [2025-04-21 14:09:36.965433] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:36.967234] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=38] current monitor number(seq_=-1) [2025-04-21 14:09:36.967573] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE11-0-0] [lt=91] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:36.968794] INFO [COMMON] handle (ob_io_struct.cpp:2969) [620126][T1001_DiskCB0][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=142] callback runner call handle(get_queue_count()=0, req={is_inited_:true, tenant_id_:1001, control_block_:0x7f3c91abe628, ref_cnt_:1, raw_buf_:0x7f3be735a150, fd_:{first_id:1152921504606848591, second_id:1616, third_id:0, fd_id:-1, slot_version:-1, device_handle:0x7f3c91a4a080}, trace_id_:YB420B1D7AB6-00063343B42EFE84-0-0, retry_count_:0, tenant_io_mgr_:{ptr:0x7f3c4dde6030}, storage_accesser:{ptr:null}, io_result_:{is_inited_:true, is_finished_:false, is_canceled_:false, has_estimated_:false, complete_size_:4096, offset_:488060, size_:293, timeout_us_:10000000, result_ref_cnt_:2, out_ref_cnt_:1, flag_:{mode:"READ", group_id_:0, func_type_:0, wait_event_id_:1, is_sync_:false, is_unlimited_:false, is_detect_:false, is_write_through_:false, is_sealed_:true, is_time_detect_:false, need_close_dev_and_fd_:false, reserved_:0}, ret_code_:{io_ret_:0, fs_errno_:0}, tenant_id_:1001, tenant_io_mgr_:{ptr:0x7f3c4dde6030}, user_data_buf_:null, buf_:null, io_callback_:0x7f3be7dd2080, time_log:{begin_ts:1745215776968150, enqueue_used:9, dequeue_used:34, submit_used:15, return_used:547, callback_enqueue_used:7, callback_dequeue_used:28, callback_finish_used:-1, end_used:-1}}, part_id:-1}) [2025-04-21 14:09:36.969541] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=34] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1}, tablet_id={id:519}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:36.969613] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=40] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:519}) [2025-04-21 14:09:36.969640] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=22] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:519}, max_saved_version=0) [2025-04-21 14:09:36.969662] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=20] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:519}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.969722] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215776969718, bytes: 5275630, bw: 0.012088 MB/s, add_ts: 1007602, add_bytes: 12772 [2025-04-21 14:09:36.969700] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=22] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c3c4ab9f0, key:{tablet_id:{id:519}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776969694}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776969694, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c3efee390, memtable_mgr_handle_:{memtable_mgr:0x7f3c3edff970, pool:0x7f3c4cfd4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c3c4ab9f0, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c4d85e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3c3edff970, ref_cnt:2, is_inited:true, tablet_id:{id:519}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c4ab9f0, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c3efe90d0}, ls_id:{id:1}, tablet_id:{id:519}}}) [2025-04-21 14:09:36.969792] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=88] succeeded to create memtable for tablet(ret=0, tablet_id={id:519}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.969822] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=24] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:519}, table_store_addr={ptr:0x7f3c032b1aa0, addr:{[ver=1,mode=0,seq=1611][2nd=1612][3rd=0][offset=987136,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c032b1460) [2025-04-21 14:09:36.969964] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=25][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:36.969995] INFO [STORAGE] check_schema_version_with_cache (ob_tablet.cpp:8153) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=26] refresh ddl data cache(ret=0, tablet_meta_.ls_id_={id:1}, tablet_id={id:101105}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:36.970031] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=20] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:101105}) [2025-04-21 14:09:36.970050] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=18] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:101105}, max_saved_version=0) [2025-04-21 14:09:36.970069] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=17] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:101105}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.970094] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=18] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c3c4ac200, key:{tablet_id:{id:101105}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776970092}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776970092, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c3efee390, memtable_mgr_handle_:{memtable_mgr:0x7f3c3edffb60, pool:0x7f3c4cfd4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c3c4ac200, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c4d85e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3c3edffb60, ref_cnt:2, is_inited:true, tablet_id:{id:101105}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c4ac200, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c3efe90d0}, ls_id:{id:1}, tablet_id:{id:101105}}}) [2025-04-21 14:09:36.970155] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=59] succeeded to create memtable for tablet(ret=0, tablet_id={id:101105}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.970179] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=20] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:101105}, table_store_addr={ptr:0x7f3c4dbdb600, addr:{[ver=1,mode=0,seq=1355][2nd=1356][3rd=0][offset=1462272,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c4dbdafc0) [2025-04-21 14:09:36.970258] INFO [STORAGE] create_memtable (ob_protected_memtable_mgr_handle.h:158) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=20] memtable_mgr_handle_ is not exist, need create(tablet_meta.ls_id_={id:1}, tablet_meta.tablet_id_={id:101106}) [2025-04-21 14:09:36.970284] INFO [STORAGE] init (ob_medium_compaction_mgr.cpp:156) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=21] success to init medium clog recorder(ret=0, ls_id={id:1}, tablet_id={id:101106}, max_saved_version=0) [2025-04-21 14:09:36.970302] INFO [STORAGE.TRANS] init_storage_recorder (ob_tablet_memtable_mgr.cpp:144) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=17] success to init storage recorder(ret=0, ls_id={id:1}, tablet_id={id:101106}, max_saved_schema_version=0, max_saved_medium_scn=0, compat_mode=0) [2025-04-21 14:09:36.970325] INFO [STORAGE] create_memtable_ (ob_tablet_memtable_mgr.cpp:346) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=18] succeed to create memtable(arg={schema_version_:0, clog_checkpoint_scn_:{val:1, v:0}, new_clog_checkpoint_scn_:{val:1, v:0}, for_replay_:false, for_inc_direct_load_:false}, ret=0, ls_id={id:1}, new_tablet_memtable={ObITabletMemtable:{ObITable:{this:0x7f3c3c4aca10, key:{tablet_id:{id:101106}, column_group_idx:0, table_type:"MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:4611686018427387903, v:0}}}, ref_cnt:2, upper_trans_version:9223372036854775807, timestamp:1745215776970323}, ls_id_:{id:1}, allow_freeze_:true, is_flushed_:false, is_tablet_freeze_:false, logging_blocked_:false, resolved_active_memtable_left_boundary_:true, unset_active_memtable_logging_blocked_:false, has_backoffed_:false, offlined_:false, read_barrier_:false, freeze_clock_:0, freeze_state_:1, unsubmitted_cnt_:0, init_timestamp_:1745215776970323, max_schema_version_:0, write_ref_cnt_:0, max_end_scn_:{val:0, v:0}, rec_scn_:{val:4611686018427387903, v:0}, freeze_scn_:{val:4611686018427387903, v:0}, freezer_:0x7f3c3efee390, memtable_mgr_handle_:{memtable_mgr:0x7f3be929a230, pool:0x7f3c4cfd4030}, mt_stat_.frozen_time_:0, mt_stat_.ready_for_flush_time_:0, mt_stat_.create_flush_dag_time_:0, mt_stat_.release_time_:0, mt_stat_.push_table_into_gc_queue_time_:0, mt_stat_.last_print_time_:0}, this:0x7f3c3c4aca10, state:0, max_data_schema_version:0, max_column_cnt:0, local_allocator:{ListHandle:{freeze_stat:0, id:-1, clock:9223372036854775807}, host:0x7f3c4d85e2b0, arena_handle:{allocated:0}}, contain_hotspot_row:false, snapshot_version:{val:4611686018427387903, v:0}, contain_hotspot_row:false, ls_id:{id:1}, transfer_freeze_flag:false, recommend_snapshot_version:{val:18446744073709551615, v:3}}, this={ObIMemtableMgr:{Memtables:this:0x7f3be929a230, ref_cnt:2, is_inited:true, tablet_id:{id:101106}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c4aca10, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, schema_recorder:{ObIStorageClogRecorder:{max_saved_version_:0, clog_scn_:{val:18446744073709551615, v:3}, log_handler_:0x7f3c3efe90d0}, ls_id:{id:1}, tablet_id:{id:101106}}}) [2025-04-21 14:09:36.970382] INFO [STORAGE] inner_create_memtable (ob_tablet.cpp:5178) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=56] succeeded to create memtable for tablet(ret=0, tablet_id={id:101106}, ls_id={id:1}, schema_version=0, for_replay=false, for_direct_load=false, input_clog_checkpoint_scn={val:1, v:0}, latest_clog_checkpoint_scn={val:1, v:0}) [2025-04-21 14:09:36.970404] INFO [STORAGE] create_memtable (ob_tablet.cpp:5124) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=19] table store update memtable success(ret=0, ls_id={id:1}, tablet_id={id:101106}, table_store_addr={ptr:0x7f3c4db27ac4, addr:{[ver=1,mode=0,seq=1096][2nd=1097][3rd=0][offset=2052096,size=320,type=2,seq=1][trans_seq=0, sec_part=0][6th=1]}}, this=0x7f3c4db27460) [2025-04-21 14:09:36.970657] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1745215776969932000, start_id=1745215776969932000, end_id=1745215776969932001) [2025-04-21 14:09:36.972096] WDIAG [SERVER] scheduler_job (ob_dbms_sched_job_master.cpp:263) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=42][errcode=0] job is timeout, force update for end(job_info={tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215176259664, start_date_:1745214957074148, last_date_:0, this_date_:1745215176259664, next_date_:1745215857074148, end_date_:64060560000000000, total_:600698129, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, now=1745215776957734) [2025-04-21 14:09:36.972153] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE84-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:36.973767] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:36.973813] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:36.983496] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=119] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:36.993104] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.006954] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03AD-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.007523] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03AE-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.007600] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=18] get number(ret=0, service_type_=0, range=1, base_id=1745215777007108000, start_id=1745215777007108000, end_id=1745215777007108001) [2025-04-21 14:09:37.009329] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215776806559000, v:0}, new_max_version={val:1745215776806559000, v:0}, last_min_version={val:1745215776607306000, v:0}, last_max_version={val:1745215776607306000, v:0}, total_time_us=3192, delta_us=202767) [2025-04-21 14:09:37.009376] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215776806559000, v:0}, min_version={val:1745215776806559000, v:0}, max_version={val:1745215776806559000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:37.025331] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43580047360, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:37.035145] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:09:37.035229] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1347, avg_log_submit_to_slide_time=1363) [2025-04-21 14:09:37.035308] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1964, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:37.035377] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1341, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:37.035410] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:37.035439] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3405) [2025-04-21 14:09:37.035469] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:37.035496] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1451, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:37.035510] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1381, avg_log_submit_to_slide_time=1395) [2025-04-21 14:09:37.035534] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=40, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:37.035726] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=18] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:37.035763] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=35] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:37.035767] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC4-0-0] [lt=18] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:37.035808] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC4-0-0] [lt=37] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:37.042405] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=41] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:37.053562] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215777053559, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007613, add_bytes: 0 [2025-04-21 14:09:37.061054] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=553627648, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=520114176, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:37.061144] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=53] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:37.061173] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=279, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:37.061231] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:37.061307] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=25] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:37.061333] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=30, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:37.083191] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:37.093178] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.096176] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:37.096233] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.104470] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=9657, avg_group_log_size=742) [2025-04-21 14:09:37.104515] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:37.106058] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9657, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:37.150399] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=35] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:37.150462] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] try gc retain ctx [2025-04-21 14:09:37.150477] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:37.150527] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215777007108000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215767099161001, v:0}, keep_alive_scn_:{val:1745215772003323001, v:0}, update_ts_:1745215777150368}) [2025-04-21 14:09:37.151471] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215785197259000, latest_log_ts:{val:1745215768600374001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:37.193252] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.203025] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215777104166000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215777202960}, version_delta=98855) [2025-04-21 14:09:37.206296] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215777007108000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199178, in_cluster_service=true, cluster_version={val:1745215776806559000, v:0}, min_cluster_version={val:1745215776806559000, v:0}, max_cluster_version={val:1745215776806559000, v:0}, get_cluster_version_err=0, cluster_version_delta=399727, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1561, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=114736423, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:37.225820] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43580047360, global_cache_size=258015232, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:37.235402] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:09:37.235545] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3405) [2025-04-21 14:09:37.235620] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3405, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:37.248283] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=353, get_gts_with_stc_cnt=31, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=30, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:37.248325] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:37.261529] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD7-0-0] [lt=39] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:37.261576] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD7-0-0] [lt=40] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2025-04-21 14:09:37.268060] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4121, offset=92862}, end_cursor:ObLogCursor{file_id=3, log_id=4122, offset=93168}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77834050, len:1346, log_data_len:306, seq:4121, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:37.268331] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE85-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:37.268393] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE85-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215776766703004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215776766703004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:37.274476] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4122, offset=93168}, end_cursor:ObLogCursor{file_id=3, log_id=4123, offset=93465}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77838050, len:1040, log_data_len:297, seq:4122, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:37.274704] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE85-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:37.274758] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE85-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215776766703004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215776766703004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:37.283287] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=51] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:37.293312] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.327981] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE22-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:37.328026] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE22-0-0] [lt=42] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:37.350773] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=127] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3962) [2025-04-21 14:09:37.364270] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215777364136000, start_id=1745215777364136000, end_id=1745215777364136001) [2025-04-21 14:09:37.376675] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE8A-0-0] [lt=13] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:37.393178] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:37.393229] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.393380] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.409440] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=77] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:37.410662] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:37.410735] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:37.410906] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:37.411014] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1001, io_status=sys_group_name:ROOT_BLOCK_IO, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8177, [delay/us]:prepare:6, schedule:30, submit:11, rt:501, total:549) [2025-04-21 14:09:37.411055] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS TENANT](tenant_id=1001, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:37.411106] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS FUNCTION](tenant_id=1001, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:6, schedule:30, submit:11, device:501, total:549) [2025-04-21 14:09:37.411163] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:37.411235] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:16, schedule:35, submit:7, rt:1202, total:1261) [2025-04-21 14:09:37.411300] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:37.411332] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8176, [delay/us]: prepare:16, schedule:35, submit:7, device:1202, total:1261) [2025-04-21 14:09:37.411399] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:37.411464] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:460, total:473) [2025-04-21 14:09:37.411533] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:37.411565] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4088, [delay/us]: prepare:0, schedule:0, submit:600000000, device:460, total:473) [2025-04-21 14:09:37.411620] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:37.411640] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:37.424073] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:37.426299] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:37.435745] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019B-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.438075] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019B-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254982988382, cache_obj->added_lc()=false, cache_obj->get_object_id()=754, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.439639] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:37.441362] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:37.441425] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=52] temporary file module use no blocks [2025-04-21 14:09:37.441446] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:37.441471] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:37.441494] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254981991589, flush_io_finished_ret_:0, flush_io_finished_round_:169, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:37.456621] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:37.457852] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:37.457947] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215771218295000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:37.473927] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:37.473981] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.474766] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.474827] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.475636] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.475698] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.483433] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:37.493449] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.496543] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=79] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:37.505368] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF0097-0-0] [lt=50] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965189504623413086e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.978644970563511833e+02) [2025-04-21 14:09:37.583079] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:37.593516] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.596391] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:37.596465] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.602611] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=23] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:37.602705] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=60] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=34) [2025-04-21 14:09:37.603211] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:37.607785] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:37.607833] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:37.609696] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:37.609731] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:37.626834] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:37.634404] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:37.634457] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:37.686927] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=33] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:37.688136] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:37.688232] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215775613757000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:37.688451] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8100000, replace_num=100000) [2025-04-21 14:09:37.688494] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:37.689746] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=48] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585000472576, fast_delete_log_mode=false) [2025-04-21 14:09:37.693583] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.695403] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695442] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695696] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=27] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695796] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695800] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695860] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695919] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.695984] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.696076] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.696408] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.696444] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:37.705100] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9657) [2025-04-21 14:09:37.709322] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=36][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:37.720834] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDA-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:37.732392] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019D-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.734434] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:37.734489] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:37.734524] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:37.734546] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:37.734590] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:37.734612] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:37.734796] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019D-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254983285103, cache_obj->added_lc()=false, cache_obj->get_object_id()=755, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.735851] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1273, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:37.735913] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:37.735988] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:37.736014] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1394, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:37.736044] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:37.743937] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=56] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:37.748959] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215777748943], gts:1745215777748905000, latest_srr:[mts=1745215777748943]}) [2025-04-21 14:09:37.756253] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE22-0-0] [lt=24][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.756253] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B0-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.757834] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B2-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.757852] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE24-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.762703] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B3-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.763977] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B5-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.764805] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:37.793651] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.795455] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=36] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:37.808612] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:37.808678] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3523, avg_group_log_size=352) [2025-04-21 14:09:37.808709] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:37.810354] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1334, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:37.810408] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3523) [2025-04-21 14:09:37.810451] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:37.810515] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3523) [2025-04-21 14:09:37.810578] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:37.810605] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1466, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:37.810619] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1422, avg_log_submit_to_slide_time=1442) [2025-04-21 14:09:37.810647] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:37.810759] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3523, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:37.817783] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:37.817841] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=51] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:37.827342] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:37.828423] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=33] gc stale ls task succ [2025-04-21 14:09:37.836145] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019F-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10006, add_timestamp:1745215777836114}) [2025-04-21 14:09:37.836219] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE38-0-0] [lt=24] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10006, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777836185, sql_renew_time:1745215777836185, is_mark_fail:false}]) [2025-04-21 14:09:37.836289] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE38-0-0] [lt=68] success to process renew task(task={tenant_id:1, table_id:10006, add_timestamp:1745215777836114}, locations=[{table_id:10006, partition_id:10006, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777836185, sql_renew_time:1745215777836185, is_mark_fail:false}]) [2025-04-21 14:09:37.836472] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=5000000, clean_num=200000) [2025-04-21 14:09:37.836568] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019F-0-0] [lt=61][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=secure_file_priv) [2025-04-21 14:09:37.836817] WDIAG [SHARE] inner_to_show_str (ob_system_variable.cpp:516) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF019F-0-0] [lt=37][errcode=0] sys var casted obj is not ObVarcharType(ret=0, value={"NULL":"NULL"}, *res_obj={"NULL":"NULL"}, get_name()=external_user) [2025-04-21 14:09:37.839467] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=34] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:37.839886] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:37.839936] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:37.839958] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:37.839984] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:37.840017] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=32] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254982390104, flush_io_finished_ret_:0, flush_io_finished_round_:169, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:37.853229] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A3-0-0] [lt=36] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215777853204}) [2025-04-21 14:09:37.853267] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE39-0-0] [lt=44] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.853424] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=46] new mysql sessid created(conn.sessid_=3221487837, support_ssl=false) [2025-04-21 14:09:37.853514] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=43] sm conn init succ(conn.sessid_=3221487837, sess.client_addr_="127.0.0.1:39890") [2025-04-21 14:09:37.853527] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=76] new mysql sessid created(conn.sessid_=3221487838, support_ssl=false) [2025-04-21 14:09:37.853537] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] new mysql sessid created(conn.sessid_=3221487839, support_ssl=false) [2025-04-21 14:09:37.853551] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487837, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:205}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853602] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=40] sm conn init succ(conn.sessid_=3221487839, sess.client_addr_="127.0.0.1:39880") [2025-04-21 14:09:37.853630] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3bc7c42d70, session_id:3221487839, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853627] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=39] sm conn init succ(conn.sessid_=3221487838, sess.client_addr_="127.0.0.1:39896") [2025-04-21 14:09:37.853669] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] new mysql sessid created(conn.sessid_=3221487840, support_ssl=false) [2025-04-21 14:09:37.853667] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] accept one succ(*s={this:0x7f3bc7c42030, session_id:3221487838, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853708] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487840, sess.client_addr_="127.0.0.1:39898") [2025-04-21 14:09:37.853728] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3bc7c44030, session_id:3221487840, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853724] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40] new mysql sessid created(conn.sessid_=3221487841, support_ssl=false) [2025-04-21 14:09:37.853788] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221487841, sess.client_addr_="127.0.0.1:39912") [2025-04-21 14:09:37.853810] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=35] new mysql sessid created(conn.sessid_=3221487842, support_ssl=false) [2025-04-21 14:09:37.853823] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] accept one succ(*s={this:0x7f3bc7c44d70, session_id:3221487841, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853863] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] sm conn init succ(conn.sessid_=3221487842, sess.client_addr_="127.0.0.1:39926") [2025-04-21 14:09:37.853871] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] new mysql sessid created(conn.sessid_=3221487843, support_ssl=false) [2025-04-21 14:09:37.853886] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] new mysql sessid created(conn.sessid_=3221487844, support_ssl=false) [2025-04-21 14:09:37.853886] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=20] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487842, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853917] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487843, sess.client_addr_="127.0.0.1:39914") [2025-04-21 14:09:37.853897] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE39-0-0] [lt=42] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777853867, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.853931] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] sm conn init succ(conn.sessid_=3221487844, sess.client_addr_="127.0.0.1:39942") [2025-04-21 14:09:37.853942] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c46030, session_id:3221487843, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853954] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487845, support_ssl=false) [2025-04-21 14:09:37.853952] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3bc7c46d70, session_id:3221487844, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.853950] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE39-0-0] [lt=52] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215777853204}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777853867, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.853994] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487845, sess.client_addr_="127.0.0.1:39946") [2025-04-21 14:09:37.854015] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487845, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.854045] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=67] new mysql sessid created(conn.sessid_=3221487846, support_ssl=false) [2025-04-21 14:09:37.854104] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] sm conn init succ(conn.sessid_=3221487846, sess.client_addr_="127.0.0.1:39954") [2025-04-21 14:09:37.854127] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=18] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487846, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.854153] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487847, support_ssl=false) [2025-04-21 14:09:37.854216] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487848, support_ssl=false) [2025-04-21 14:09:37.854219] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221487847, sess.client_addr_="127.0.0.1:39968") [2025-04-21 14:09:37.854243] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] accept one succ(*s={this:0x7f3bc7c48030, session_id:3221487847, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.854258] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] sm conn init succ(conn.sessid_=3221487848, sess.client_addr_="127.0.0.1:39972") [2025-04-21 14:09:37.854276] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487848, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:227}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.854317] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487849, support_ssl=false) [2025-04-21 14:09:37.854377] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=27] sm conn init succ(conn.sessid_=3221487849, sess.client_addr_="127.0.0.1:39974") [2025-04-21 14:09:37.854400] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3c20e8c030, session_id:3221487849, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:229}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.854436] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854481] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854484] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854500] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=18] mysql login queue(mysql_queue->queue_.size()=1) [2025-04-21 14:09:37.854520] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=22] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854533] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854540] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854557] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854570] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=22] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854593] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854612] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854616] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854633] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=16] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854627] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBE-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.854634] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBC-0-0] [lt=34] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.854652] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC0-0-0] [lt=34] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.854805] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854834] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=23] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854944] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854932] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.854971] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=22] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.854974] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=32] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.855016] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.855043] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=21] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.855362] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.855420] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=47] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.855467] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=29] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.855501] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=26] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.855541] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:37.855575] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=26] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:37.855627] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBC-0-0] [lt=27] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487847, proxy_sessid=0, client_sessid=3221487847, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.855644] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBE-0-0] [lt=29] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487848, proxy_sessid=0, client_sessid=3221487848, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.855754] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBD-0-0] [lt=43] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.855785] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBF-0-0] [lt=48] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.855914] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC0-0-0] [lt=125] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487846, proxy_sessid=0, client_sessid=3221487846, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.856019] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCE-0-0] [lt=22] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215777856002}) [2025-04-21 14:09:37.856025] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=33][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215777856020}) [2025-04-21 14:09:37.856038] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC1-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.856062] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCE-0-0] [lt=29] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215777856057}) [2025-04-21 14:09:37.856053] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=28][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215777856020}) [2025-04-21 14:09:37.856082] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=27][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857390, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.856070] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3A-0-0] [lt=33] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856051, sql_renew_time:1745215777856051, is_mark_fail:false}]) [2025-04-21 14:09:37.856139] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=31][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215777856136}) [2025-04-21 14:09:37.856122] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3A-0-0] [lt=51] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215777856002}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856051, sql_renew_time:1745215777856051, is_mark_fail:false}]) [2025-04-21 14:09:37.856161] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=20][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215777856136}) [2025-04-21 14:09:37.856178] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A4-0-0] [lt=17][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762857441, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.856187] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3B-0-0] [lt=39] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856174, sql_renew_time:1745215777856174, is_mark_fail:false}]) [2025-04-21 14:09:37.856227] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3B-0-0] [lt=40] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215777856057}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856174, sql_renew_time:1745215777856174, is_mark_fail:false}]) [2025-04-21 14:09:37.856551] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDBF-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487844, proxy_sessid=0, client_sessid=3221487844, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.856661] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC0-0-0] [lt=40] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.856751] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBD-0-0] [lt=26] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487845, proxy_sessid=0, client_sessid=3221487845, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.856839] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC1-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487842, proxy_sessid=0, client_sessid=3221487842, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.856867] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBE-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.856956] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC2-0-0] [lt=37] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.857204] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD99-0-0] [lt=24] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215777857184}) [2025-04-21 14:09:37.857209] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9B-0-0] [lt=12][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215777857197}) [2025-04-21 14:09:37.857251] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9B-0-0] [lt=40][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215777857197}) [2025-04-21 14:09:37.857274] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9B-0-0] [lt=21][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762866163, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.857291] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8D-0-0] [lt=41] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215777857285}) [2025-04-21 14:09:37.857444] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC0-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487840, proxy_sessid=0, client_sessid=3221487840, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.857544] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC1-0-0] [lt=31] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.857834] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC2-0-0] [lt=26] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487837, proxy_sessid=0, client_sessid=3221487837, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.857948] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC3-0-0] [lt=42] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.857922] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487842, trace_id:YB420B1D7AB6-00063343B62EFDAA-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215777857312, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.857964] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=13][errcode=0] server close connection(sessid=3221487842, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.857986] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=53] kill and revert session(conn.sessid_=3221487842, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.858010] INFO [SERVER] process (obmp_quit.h:56) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=41] quit [2025-04-21 14:09:37.858039] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=27][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.858015] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBE-0-0] [lt=20] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487839, proxy_sessid=0, client_sessid=3221487839, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.858063] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=22][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.858082] WDIAG [SERVER] response (obmp_base.cpp:87) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.858102] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.858124] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.858145] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAA-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.858169] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBF-0-0] [lt=52] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.858179] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=32][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.858408] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAB-0-0] [lt=16] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215777858402}) [2025-04-21 14:09:37.858838] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC3-0-0] [lt=17] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487843, proxy_sessid=0, client_sessid=3221487843, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.858313] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC1-0-0] [lt=21] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487849, proxy_sessid=0, client_sessid=3221487849, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.858974] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC4-0-0] [lt=32] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:37.858972] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=24] can close safely, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487842, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:221}, err:5, last_decode_time:1745215777857312, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:208, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.859061] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=49] unlock session of tenant(conn.sessid_=3221487842, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.859098] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34] connection close(sessid=3221487842, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B72EFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.859180] INFO [SERVER] run (obmp_disconnect.cpp:82) [620067][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=33] free session successfully(sessid=3221487842) [2025-04-21 14:09:37.859209] INFO [SERVER] run (obmp_disconnect.cpp:89) [620067][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=27] mark session id unused(sessid=3221487842) [2025-04-21 14:09:37.859351] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDBF-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487841, proxy_sessid=0, client_sessid=3221487841, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.859414] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3C-0-0] [lt=34] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.859891] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC4-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487838, proxy_sessid=0, client_sessid=3221487838, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:37.859908] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD94-0-0] [lt=40][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215777859901}) [2025-04-21 14:09:37.859949] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD94-0-0] [lt=40][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215777859901}) [2025-04-21 14:09:37.859971] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620049][T1_L0_G0][T1][YB420B1D7AB6-00063343B64EFD94-0-0] [lt=19][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215762858349, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.859389] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD91-0-0] [lt=35] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215777859362}) [2025-04-21 14:09:37.860791] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3C-0-0] [lt=42] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777860763, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.860833] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3C-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215777857184}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777860763, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.860876] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3D-0-0] [lt=25] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.860911] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42030, session_id:3221487838, trace_id:YB420B1D7AB6-00063343B88EFD94-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215777860583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.860976] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=55] kill and revert session(conn.sessid_=3221487838, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.861076] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=18][errcode=0] server close connection(sessid=3221487838, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.861115] INFO [SERVER] process (obmp_quit.h:56) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=35] quit [2025-04-21 14:09:37.861132] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.861148] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=15][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.861160] WDIAG [SERVER] response (obmp_base.cpp:87) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=12][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.861173] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=11][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.861189] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.861202] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD94-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.861214] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620047][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.861769] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3D-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777861750, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.861758] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487846, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215777861676, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.861818] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3D-0-0] [lt=47] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215777857285}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777861750, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.861830] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=61] kill and revert session(conn.sessid_=3221487846, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.861863] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3E-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.861947] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8A-0-0] [lt=39] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215777861936}) [2025-04-21 14:09:37.861956] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8E-0-0] [lt=34] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215777861937}) [2025-04-21 14:09:37.861994] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8A-0-0] [lt=33] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215777861992}) [2025-04-21 14:09:37.862017] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8A-0-0] [lt=15] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215777862016}) [2025-04-21 14:09:37.862018] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620067][T1_L0_G0][T1][YB420B1D7AB6-00063343B69EFD8D-0-0] [lt=12] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:37.862037] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8A-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215777862035}) [2025-04-21 14:09:37.862057] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8A-0-0] [lt=13] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215777862055}) [2025-04-21 14:09:37.862082] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620067][T1_L0_G0][T1001][YB420B1D7AB6-00063343B69EFD8D-0-0] [lt=26] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:37.862108] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620067][T1_L0_G0][T1002][YB420B1D7AB6-00063343B69EFD8D-0-0] [lt=13] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:37.862319] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=27][errcode=0] server close connection(sessid=3221487846, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.862360] INFO [SERVER] process (obmp_quit.h:56) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=33] quit [2025-04-21 14:09:37.862381] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=19][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.862400] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.862417] WDIAG [SERVER] response (obmp_base.cpp:87) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=15][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.862434] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=14][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.862453] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.862471] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD91-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.862486] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620051][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=14][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.862767] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=17] can close safely, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487846, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215777861676, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:476, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.862824] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=42] unlock session of tenant(conn.sessid_=3221487846, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.862849] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=23] connection close(sessid=3221487846, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDA9-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.862923] INFO [SERVER] run (obmp_disconnect.cpp:82) [620065][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=42] free session successfully(sessid=3221487846) [2025-04-21 14:09:37.862955] INFO [SERVER] run (obmp_disconnect.cpp:89) [620065][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=30] mark session id unused(sessid=3221487846) [2025-04-21 14:09:37.863045] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3bc7c42030, session_id:3221487838, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:218}, err:5, last_decode_time:1745215777860583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:244, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.863102] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=40] unlock session of tenant(conn.sessid_=3221487838, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.863136] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] connection close(sessid=3221487838, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD93-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.863189] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] free session successfully(sessid=3221487838) [2025-04-21 14:09:37.863226] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=35] mark session id unused(sessid=3221487838) [2025-04-21 14:09:37.863667] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=56][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c48030, session_id:3221487847, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215777863207, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.863727] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=50] kill and revert session(conn.sessid_=3221487847, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.863803] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=33][errcode=0] server close connection(sessid=3221487847, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.863819] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=69][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487848, trace_id:YB420B1D7AB6-00063343B72EFD8F-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215777863207, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.863842] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=36] quit [2025-04-21 14:09:37.863868] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=25][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.863871] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=45] kill and revert session(conn.sessid_=3221487848, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.863860] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=45][errcode=0] server close connection(sessid=3221487848, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.863889] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=20][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.863899] INFO [SERVER] process (obmp_quit.h:56) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=36] quit [2025-04-21 14:09:37.863907] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.863920] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=20][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.863925] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=16][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.863940] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.863946] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.863957] WDIAG [SERVER] response (obmp_base.cpp:87) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=16][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.863965] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDCF-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.863975] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=16][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.863982] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.863996] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.864014] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620053][T1_L0_G0][T1][YB420B1D7AB6-00063343B72EFD8F-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.864031] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620053][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.864236] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42d70, session_id:3221487839, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215777860583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.864291] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=47] kill and revert session(conn.sessid_=3221487839, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.864311] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] sock ref clean, do destroy(*s={this:0x7f3bc7c42d70, session_id:3221487839, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215777860583, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.864341] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] unlock session of tenant(conn.sessid_=3221487839, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.864355] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487839, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B72EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:25, seq_:31}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:32}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:37.864492] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487839) [2025-04-21 14:09:37.864515] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=21] mark session id unused(sessid=3221487839) [2025-04-21 14:09:37.864528] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD99-0-0] [lt=40][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:37.864945] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c46d70, session_id:3221487844, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215777856231, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.864987] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=36] kill and revert session(conn.sessid_=3221487844, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.865034] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=44] sock ref clean, do destroy(*s={this:0x7f3bc7c46d70, session_id:3221487844, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215777856231, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:346, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.865072] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] unlock session of tenant(conn.sessid_=3221487844, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.865076] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAB-0-0] [lt=45][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:37.865090] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] connection close(sessid=3221487844, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD99-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:37.865177] INFO [SERVER] run (obmp_disconnect.cpp:82) [620059][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=56] free session successfully(sessid=3221487844) [2025-04-21 14:09:37.865206] INFO [SERVER] run (obmp_disconnect.cpp:89) [620059][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=28] mark session id unused(sessid=3221487844) [2025-04-21 14:09:37.865486] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] can close safely, do destroy(*s={this:0x7f3bc7c48030, session_id:3221487847, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:226}, err:5, last_decode_time:1745215777863207, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:743, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.865533] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487847, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.865548] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487847, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF01A4-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.865328] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3E-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777865292, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.865683] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3E-0-0] [lt=352] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215777858402}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777865292, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.865744] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3F-0-0] [lt=39] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.865757] INFO [SERVER] run (obmp_disconnect.cpp:82) [620068][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] free session successfully(sessid=3221487847) [2025-04-21 14:09:37.865797] INFO [SERVER] run (obmp_disconnect.cpp:89) [620068][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=39] mark session id unused(sessid=3221487847) [2025-04-21 14:09:37.865857] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c46030, session_id:3221487843, trace_id:YB420B1D7AB6-00063343B6BEFD8F-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215777865597, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.865879] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=17][errcode=0] server close connection(sessid=3221487843, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.865873] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=87][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e8c030, session_id:3221487849, trace_id:YB420B1D7AB6-00063343B4AF01A5-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:229}, err:5, last_decode_time:1745215777865597, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.865921] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=41] kill and revert session(conn.sessid_=3221487849, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.865917] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=52] kill and revert session(conn.sessid_=3221487843, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.865912] INFO [SERVER] process (obmp_quit.h:56) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=30] quit [2025-04-21 14:09:37.865914] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=11][errcode=0] server close connection(sessid=3221487849, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.865946] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=32][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.865949] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=32] quit [2025-04-21 14:09:37.865959] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=13][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.865972] WDIAG [SERVER] response (obmp_base.cpp:87) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.865970] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=20][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.865984] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=11][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.865990] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=18][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.865999] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866007] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=16][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.866011] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620068][T1_L0_G0][T1][YB420B1D7AB6-00063343B6BEFD8F-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866023] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=15][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.866036] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620068][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866041] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866060] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A5-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866077] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.866141] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3F-0-0] [lt=21] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866122, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.866177] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE3F-0-0] [lt=35] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215777859362}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866122, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.866229] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE40-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866215, sql_renew_time:1745215777866215, is_mark_fail:false}]) [2025-04-21 14:09:37.866260] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE40-0-0] [lt=29] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215777861936}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866215, sql_renew_time:1745215777866215, is_mark_fail:false}]) [2025-04-21 14:09:37.866295] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE41-0-0] [lt=24] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:37.866428] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487837, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215777857312, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.866468] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34] kill and revert session(conn.sessid_=3221487837, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.866484] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=14] can close safely, do destroy(*s={this:0x7f3c20e8c030, session_id:3221487849, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:229}, err:5, last_decode_time:1745215777865597, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:672, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.866514] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] unlock session of tenant(conn.sessid_=3221487849, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.866532] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] connection close(sessid=3221487849, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B69EFD8D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.866577] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487849) [2025-04-21 14:09:37.866579] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=44] sock ref clean, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487837, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:205}, err:5, last_decode_time:1745215777857312, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.866603] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=24] mark session id unused(sessid=3221487849) [2025-04-21 14:09:37.866587] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9B-0-0] [lt=36][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:37.866610] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] unlock session of tenant(conn.sessid_=3221487837, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.866623] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=11] connection close(sessid=3221487837, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDAB-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:37.866656] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=10] free session successfully(sessid=3221487837) [2025-04-21 14:09:37.866675] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] mark session id unused(sessid=3221487837) [2025-04-21 14:09:37.866757] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE41-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866741, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.866800] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE41-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215777861937}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866741, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:37.866854] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE42-0-0] [lt=29] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866842, sql_renew_time:1745215777866842, is_mark_fail:false}]) [2025-04-21 14:09:37.866872] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=22] can close safely, do destroy(*s={this:0x7f3bc7c46030, session_id:3221487843, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:222}, err:5, last_decode_time:1745215777865597, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:544, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.866887] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE42-0-0] [lt=32] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215777861992}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866842, sql_renew_time:1745215777866842, is_mark_fail:false}]) [2025-04-21 14:09:37.866918] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487843, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.866937] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE43-0-0] [lt=28] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866925, sql_renew_time:1745215777866925, is_mark_fail:false}]) [2025-04-21 14:09:37.866934] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487843, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B70EFD91-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.866965] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=28] free session successfully(sessid=3221487843) [2025-04-21 14:09:37.866963] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE43-0-0] [lt=26] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215777862016}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866925, sql_renew_time:1745215777866925, is_mark_fail:false}]) [2025-04-21 14:09:37.866984] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=18] mark session id unused(sessid=3221487843) [2025-04-21 14:09:37.866979] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=39][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44d70, session_id:3221487841, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:220}, err:5, last_decode_time:1745215777866677, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.867005] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=20] kill and revert session(conn.sessid_=3221487841, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.867013] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=11][errcode=0] server close connection(sessid=3221487841, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.867028] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=13] quit [2025-04-21 14:09:37.867012] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE44-0-0] [lt=27] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777867001, sql_renew_time:1745215777867001, is_mark_fail:false}]) [2025-04-21 14:09:37.867040] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=11][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.867052] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=11][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.867041] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE44-0-0] [lt=28] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215777862035}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777867001, sql_renew_time:1745215777867001, is_mark_fail:false}]) [2025-04-21 14:09:37.867063] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.867078] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=13][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.867097] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.867110] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD0-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.867081] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=33][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487845, trace_id:YB420B1D7AB6-00063343B62EFDAC-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:224}, err:5, last_decode_time:1745215777866677, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.867095] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE45-0-0] [lt=27] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777867083, sql_renew_time:1745215777867083, is_mark_fail:false}]) [2025-04-21 14:09:37.867121] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=10][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.867122] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=26][errcode=0] server close connection(sessid=3221487845, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.867130] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=41] kill and revert session(conn.sessid_=3221487845, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.867126] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE45-0-0] [lt=30] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215777862055}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777867083, sql_renew_time:1745215777867083, is_mark_fail:false}]) [2025-04-21 14:09:37.867147] INFO [SERVER] process (obmp_quit.h:56) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=24] quit [2025-04-21 14:09:37.867164] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.867182] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=17][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.867199] WDIAG [SERVER] response (obmp_base.cpp:87) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=15][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.867215] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=14][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.867234] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.867251] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAC-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.867278] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.882248] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=50] ====== tenant freeze timer task ====== [2025-04-21 14:09:37.888619] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=22] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:37.893344] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:37.893409] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.893727] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:37.905839] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=58][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44030, session_id:3221487840, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215777905339, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:224, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:37.905915] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=65] kill and revert session(conn.sessid_=3221487840, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:37.906037] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=29][errcode=0] server close connection(sessid=3221487840, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:37.906079] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=39] quit [2025-04-21 14:09:37.906102] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=21][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:37.906124] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=21][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:37.906138] WDIAG [SERVER] response (obmp_base.cpp:87) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=13][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:37.906151] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=12][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:37.906173] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.906192] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A6-0-0] [lt=17][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.906208] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:37.924990] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=48] LogLoopThread round_cost_time(us)(round_cost_time=25) [2025-04-21 14:09:37.940460] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] can close safely, do destroy(*s={this:0x7f3bc7c44030, session_id:3221487840, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:217}, err:5, last_decode_time:1745215777905339, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:229, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:37.940548] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=66] unlock session of tenant(conn.sessid_=3221487840, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:37.940578] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] connection close(sessid=3221487840, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B8FEFD8A-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:37.940699] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487840) [2025-04-21 14:09:37.940737] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487840) [2025-04-21 14:09:37.940777] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B7-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.942499] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03B9-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:37.942998] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=77] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:37.959481] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE85-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:37.966114] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1323, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:37.966157] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9658) [2025-04-21 14:09:37.966192] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:37.966217] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9658) [2025-04-21 14:09:37.966275] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:37.966300] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1457, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:37.966319] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1419, avg_log_submit_to_slide_time=1436) [2025-04-21 14:09:37.966357] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:37.974096] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:37.974149] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:37.977345] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=42] PNIO [ratelimit] time: 1745215777977340, bytes: 5292811, bw: 0.016261 MB/s, add_ts: 1007622, add_bytes: 17181 [2025-04-21 14:09:37.993796] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.010733] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=20] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215777807693000, v:0}, new_max_version={val:1745215777807693000, v:0}, last_min_version={val:1745215777607929000, v:0}, last_max_version={val:1745215777607929000, v:0}, total_time_us=3797, delta_us=203036) [2025-04-21 14:09:38.010783] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215777807693000, v:0}, min_version={val:1745215777807693000, v:0}, max_version={val:1745215777807693000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:38.010982] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03BC-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.011552] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03BD-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.036196] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1491, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:38.036264] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:38.036254] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:38.036336] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:38.036388] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:38.036414] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1624, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:38.036434] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1583, avg_log_submit_to_slide_time=1597) [2025-04-21 14:09:38.036469] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:38.036511] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1498, avg_log_submit_to_slide_time=1517) [2025-04-21 14:09:38.036562] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:38.036962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=33] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:38.042528] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=35] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:38.061199] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1745215778061194, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2025-04-21 14:09:38.061380] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFE26-0-0] [lt=66] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:09:38.088776] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:38.093872] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.096613] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=37] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:38.096666] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.105594] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7775, avg_group_log_size=647) [2025-04-21 14:09:38.105643] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:38.107444] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7775, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:38.160808] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=70] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:38.193941] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.236027] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:38.236095] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:38.236205] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:38.237476] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:38.249225] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] ts response task statistics(alloc_count=3822, free_count=1910) [2025-04-21 14:09:38.249282] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:38.281059] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=38] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4123, offset=93465}, end_cursor:ObLogCursor{file_id=3, log_id=4124, offset=93771}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7783c050, len:743, log_data_len:306, seq:4123, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:38.281396] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE86-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:38.281481] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE86-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215777748905004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215777748905004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:38.288132] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=66] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4124, offset=93771}, end_cursor:ObLogCursor{file_id=3, log_id=4125, offset=94068}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77840050, len:437, log_data_len:297, seq:4124, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:38.288467] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE86-0-0] [lt=53] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:38.288550] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE86-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215777748905004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215777748905004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:38.288940] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=65] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:38.294016] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.329950] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE23-0-0] [lt=18] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:38.330009] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE23-0-0] [lt=57] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:38.351516] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3531) [2025-04-21 14:09:38.365216] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F00A5-0-0] [lt=42] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215778364169, can_tenant_elr:true}) [2025-04-21 14:09:38.367061] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26489990, this={dio_aligned_buf:{buf_write_offset:1747, buf_padding_size:2349, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:6985, truncate_used_ts:2876}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26488832, buf_len=589, total_write_size=83604, total_write_size_after_dio=618496, ob_pwrite_used_ts=207338, count=131, each_pwrite_cost=1582) [2025-04-21 14:09:38.393517] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:38.393590] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.394087] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.411040] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:38.411098] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:38.412689] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS SERVER] net_in=15kB/s, net_out=15kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:38.412750] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:38.412927] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:38.413121] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:38.413205] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:21, schedule:41, submit:9, rt:1583, total:1654) [2025-04-21 14:09:38.413281] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:38.413340] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:21, schedule:41, submit:9, device:1583, total:1654) [2025-04-21 14:09:38.413399] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:38.413471] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:582, total:596) [2025-04-21 14:09:38.413549] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:38.413585] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:582, total:596) [2025-04-21 14:09:38.413650] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:38.413678] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:38.424145] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:09:38.438011] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:38.439500] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=16] can close safely, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487848, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:227}, err:5, last_decode_time:1745215777863207, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:38.439570] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=57] unlock session of tenant(conn.sessid_=3221487848, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:38.439591] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487848, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDCE-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:38.439677] INFO [SERVER] run (obmp_disconnect.cpp:82) [620056][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=24] free session successfully(sessid=3221487848) [2025-04-21 14:09:38.439720] INFO [SERVER] run (obmp_disconnect.cpp:89) [620056][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] mark session id unused(sessid=3221487848) [2025-04-21 14:09:38.439810] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:38.442093] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A7-0-0] [lt=18][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.444781] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A7-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254983995087, cache_obj->added_lc()=false, cache_obj->get_object_id()=756, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:38.446404] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=39] ====== tenant freeze timer task ====== [2025-04-21 14:09:38.474272] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:38.474322] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.474795] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.475776] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.475857] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.475918] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.489050] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:38.494165] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.506412] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF009C-0-0] [lt=18] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965189504623413086e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.978644970563511833e+02) [2025-04-21 14:09:38.559206] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=41] clear dtl interm result cost(us)(clear_cost=387, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:38.569821] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:09:38.569934] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA7-0-0] [lt=42] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215778249390002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:38.570095] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA7-0-0] [lt=124] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:38.570166] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA7-0-0] [lt=68] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:38.573617] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:38.573660] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:38.583116] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:38.592863] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:38.592913] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:38.592931] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:38.592959] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:38.592983] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254983143102, flush_io_finished_ret_:0, flush_io_finished_round_:170, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:38.594236] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.596791] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:38.596853] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.603368] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:38.607572] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:38.607611] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:38.608852] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] submit log success(service_type_=0, last_id=1745215795197259000, limited_id=1745215795197259000) [2025-04-21 14:09:38.608890] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] submit log with lock success(service_type_=0, last_id=1745215795197259000, limited_id=1745215795197259000) [2025-04-21 14:09:38.609259] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:38.609295] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:38.610725] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215795197259000, latest_scn={val:1745215778608332001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:38.610805] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=79] handle submit callback(service_type_=0, success=true, used_ts=1955, log_ts={val:1745215778608332001, v:0}, limited_id=1745215795197259000) [2025-04-21 14:09:38.610830] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=23] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:38.610850] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=19] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:38.611851] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF019A-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215778611570000, start_id=1745215778611570000, end_id=1745215778611570001) [2025-04-21 14:09:38.611992] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:38.614364] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:38.614467] WDIAG read_multi_row (ob_table_access_helper.h:238) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:38.616143] INFO delete_row (ob_table_access_helper.h:312) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215778614498) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215778614498) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:38.616275] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620289][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=41] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:38.635036] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:38.635099] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:38.638480] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:38.638567] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=20] ====== tenant freeze timer task ====== [2025-04-21 14:09:38.638600] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=25] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:38.638640] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:38.675039] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:38.676163] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=65] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:38.676239] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=74] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:38.676325] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=46] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:38.676448] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=116] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:38.676485] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:38.676514] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215774245091001, v:0}) [2025-04-21 14:09:38.676535] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:38.676561] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:38.676595] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:38.676620] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:38.676655] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:38.676692] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:38.677766] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:38.677816] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=49] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:38.677876] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=29] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:38.677949] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=70] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:38.677973] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:38.677998] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:38.678022] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:38.678044] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:38.678068] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:38.678095] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:38.678114] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:38.681402] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE86-0-0] [lt=38] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.684488] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=36] check new jobs(ret=0, tenant_id=1001, is_oracle_tenant=false, job_infos=[{tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215776957793, start_date_:1745214957074148, last_date_:1745215176259664, this_date_:0, next_date_:1745215857074148, end_date_:64060560000000000, total_:600698129, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745300457074037, last_date_:0, this_date_:0, next_date_:1745300457074037, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1001, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214057083128, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:38.684608] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620186][T1001_DBMSSched][T1001][Y0-0000000000000000-0-0] [lt=118] check all tenants(ret=0) [2025-04-21 14:09:38.686023] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE89-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.687431] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8A-0-0] [lt=39] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.688762] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8B-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.689182] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:38.690091] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8C-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.691396] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8D-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.692768] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8E-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.694319] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.695050] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620186][T1001_DBMSSched][T1001][YB420B1D7AB6-00063343B42EFE8F-0-0] [lt=37] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:38.695246] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695316] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695475] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695527] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695565] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695665] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.695772] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.696024] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.696067] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.696067] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.696160] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:38.705781] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=86] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:09:38.730134] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=74] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:38.735117] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:38.735203] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:38.735234] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:38.735264] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:38.735313] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:38.735345] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:38.737147] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1522, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:38.737191] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:38.737227] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:38.737252] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1640, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:38.737274] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:38.749786] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=29] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215778749769], gts:1745215778748839000, latest_srr:[mts=1745215778749769]}) [2025-04-21 14:09:38.759020] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03BF-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.759021] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE25-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.760932] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03C1-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.760970] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE27-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.764304] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDA9-0-0] [lt=38] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:38.764753] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03C2-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.765830] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:38.766250] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03C4-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.794400] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.795571] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=43] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:38.810052] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:38.810134] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=59] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3662, avg_group_log_size=332) [2025-04-21 14:09:38.810176] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:38.811960] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1849, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:38.812007] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3662) [2025-04-21 14:09:38.812042] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:38.812074] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3662) [2025-04-21 14:09:38.812141] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:38.812166] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2137, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:38.812186] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=158, avg_log_gen_to_submit_time=179, avg_log_submit_to_flush_time=1936, avg_log_submit_to_slide_time=1957) [2025-04-21 14:09:38.812220] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:38.812260] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3662, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:38.813667] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:38.814942] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:38.815041] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215778810123000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:38.828472] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:38.835135] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:38.835178] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] try gc retain ctx [2025-04-21 14:09:38.835198] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] try to retry start_working [2025-04-21 14:09:38.835263] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] finish update min start scn(max_decided_scn={val:1745215778249390004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215768739412000, v:0}, keep_alive_scn_:{val:1745215773744068000, v:0}, update_ts_:1745215778834906}) [2025-04-21 14:09:38.836254] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:38.836441] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=106] finish update min start scn(max_decided_scn={val:1745215778249390004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215768739412000, v:0}, keep_alive_scn_:{val:1745215773744068000, v:0}, update_ts_:1745215778835985}) [2025-04-21 14:09:38.837468] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215775746950004, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:38.839032] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43580047360, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:38.839649] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:38.839950] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] [CACHE] tenant_id= 1 cache memory info: [CACHE] tenant_id= 1 | cache_name= schema_cache | cache_size= 29129728 | cache_store_size= 27049984 | cache_map_size= 2079744 | kv_cnt= 1505 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= vtable_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 38 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 112 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 2205 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 6 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= log_kv_cache | cache_size= 70745088 | cache_store_size= 68665344 | cache_map_size= 2079744 | kv_cnt= 1005 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 171 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 52 | hold_size= 0 [CACHE] tenant_id= 1 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:38.840029] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] [CACHE] tenant_id= 1001 cache memory info: [CACHE] tenant_id= 1001 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 86 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 86 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= storage_meta_cache | cache_size= 10402816 | cache_store_size= 8323072 | cache_map_size= 2079744 | kv_cnt= 1917 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= log_kv_cache | cache_size= 31210496 | cache_store_size= 29130752 | cache_map_size= 2079744 | kv_cnt= 403 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 83 | hold_size= 0 [CACHE] tenant_id= 1001 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:38.840098] INFO print_tenant_cache_info (ob_kvcache_inst_map.cpp:525) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=21] [CACHE] tenant_id= 1002 cache memory info: [CACHE] tenant_id= 1002 | cache_name= index_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 86 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= user_block_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 87 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= storage_meta_cache | cache_size= 16645120 | cache_store_size= 14565376 | cache_map_size= 2079744 | kv_cnt= 4318 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= tx_data_kv_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= log_kv_cache | cache_size= 31210496 | cache_store_size= 29130752 | cache_map_size= 2079744 | kv_cnt= 403 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_table_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 114 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_ds_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 7 | hold_size= 0 [CACHE] tenant_id= 1002 | cache_name= opt_system_stat_cache | cache_size= 6241280 | cache_store_size= 4161536 | cache_map_size= 2079744 | kv_cnt= 1 | hold_size= 0 [2025-04-21 14:09:38.840133] INFO print_current_status (ob_kvcache_hazard_version.cpp:328) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] [KVCACHE-HAZARD] hazard version status info: current_version: 5091 | min_version= 5091 | total_nodes_count: 17 | [KVCACHE-HAZARD] i= 111 | acquire_version=18446744073709551615 | waiting_nodes_count= 14 | last_retire_version= 5074 | [KVCACHE-HAZARD] i= 454 | acquire_version=18446744073709551615 | waiting_nodes_count= 3 | last_retire_version= 5071 | [2025-04-21 14:09:38.840153] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:38.840200] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=38] temporary file module use no blocks [2025-04-21 14:09:38.840222] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:38.840255] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=30] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:38.840279] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254983390374, flush_io_finished_ret_:0, flush_io_finished_round_:170, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:38.841845] INFO [STORAGE] runTimerTask (ob_ddl_heart_beat_task.cpp:49) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=19] send to rs all task status succeed [2025-04-21 14:09:38.843374] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=60] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:38.867215] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=31] can close safely, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487845, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215777866677, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:659, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:38.867288] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=54] unlock session of tenant(conn.sessid_=3221487845, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:38.867325] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34] connection close(sessid=3221487845, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD9B-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:38.867410] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=41] free session successfully(sessid=3221487845) [2025-04-21 14:09:38.867465] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=53] mark session id unused(sessid=3221487845) [2025-04-21 14:09:38.868095] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=13] can close safely, do destroy(*s={this:0x7f3bc7c44d70, session_id:3221487841, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:220}, err:5, last_decode_time:1745215777866677, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:38.868166] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=48] unlock session of tenant(conn.sessid_=3221487841, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:38.868192] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] connection close(sessid=3221487841, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B64EFD94-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:38.868259] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=26] free session successfully(sessid=3221487841) [2025-04-21 14:09:38.868294] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=33] mark session id unused(sessid=3221487841) [2025-04-21 14:09:38.889322] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:38.893726] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=41] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:38.893790] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.894355] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=65] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:38.894488] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:38.909552] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=63] ObArchiveSender is running(thread_index=1) [2025-04-21 14:09:38.926369] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=46] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:38.943558] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03C6-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.945118] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03C8-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:38.948441] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:38.950120] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1745215778949986000, start_id=1745215778949986000, end_id=1745215778949986001) [2025-04-21 14:09:38.966413] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=36] current monitor number(seq_=-1) [2025-04-21 14:09:38.967449] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1466, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:38.967497] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9650) [2025-04-21 14:09:38.967529] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:38.967553] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9650) [2025-04-21 14:09:38.967606] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:38.967630] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=1589, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:38.967649] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1550, avg_log_submit_to_slide_time=1568) [2025-04-21 14:09:38.967685] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:38.974472] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:38.974545] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:38.984965] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215778984961, bytes: 5305583, bw: 0.012088 MB/s, add_ts: 1007621, add_bytes: 12772 [2025-04-21 14:09:38.994580] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.003399] INFO [STORAGE.BLKMGR] mark_macro_blocks (ob_block_manager.cpp:1066) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=46] no block alloc/free, no need to mark blocks(ret=0, mark_info.count()=0) [2025-04-21 14:09:39.003461] INFO [STORAGE.BLKMGR] mark_and_sweep (ob_block_manager.cpp:1046) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=55] finish once mark and sweep(ret=0, alloc_num=9, mark_info.count()=0, marker_status={total_block_count:66560, reserved_block_count:2, linked_block_count:0, tmp_file_count:0, data_block_count:0, shared_data_block_count:12, index_block_count:0, ids_block_count:0, disk_block_count:0, bloomfiter_count:0, hold_count:46, pending_free_count:4, free_count:66512, shared_meta_block_count:34, mark_cost_time:79, sweep_cost_time:0, start_time:"2025-04-21 14:09:39.3376", last_end_time:"2025-04-21 14:07:39.1988", hold_info:nothing, mark_finished:false}, map_cnt=46) [2025-04-21 14:09:39.011575] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215778809039000, v:0}, new_max_version={val:1745215778809039000, v:0}, last_min_version={val:1745215778608332002, v:0}, last_max_version={val:1745215778608332002, v:0}, total_time_us=3935, delta_us=202533) [2025-04-21 14:09:39.011624] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215778809039000, v:0}, min_version={val:1745215778809039000, v:0}, max_version={val:1745215778809039000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:39.014833] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03CB-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.015426] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03CC-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.022410] INFO [RPC.OBRPC] do_client_loop (ob_net_keepalive.cpp:654) [619654][KeepAliveClient][T0][Y0-0000000000000000-0-0] [lt=58] dump dest keepalive data states, addr: "11.29.122.182:2882", last_write_ts_=1745215778822023, last_read_ts_=1745215778621251, in_black_=0 [2025-04-21 14:09:39.032299] INFO [SHARE] run1 (ob_dynamic_thread_pool.cpp:594) [619612][qth_mgr][T0][Y0-0000000000000000-0-0] [lt=75] [thread pool stat](pool_stat={pool:0x7f3c901e9480, last_check_time:1745215779032294, last_idle_time:180730609, last_thread_count:1}, *pool={name:IO_SYNC_CH, this:0x7f3c901e9480, min_thread_cnt:1, max_thread_cnt:96, running_thread_cnt:0, threads_idle_time:180730609, tenant_id:500}, qsize=-1, current_idle_time=180730609) [2025-04-21 14:09:39.036396] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=23] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:39.036432] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=34] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:39.036438] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC5-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:39.036477] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC5-0-0] [lt=36] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:39.037161] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1585, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:39.037216] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:39.037205] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:39.037280] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:39.037328] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:39.037352] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1716, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:39.037371] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1684) [2025-04-21 14:09:39.037405] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:39.037450] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1567, avg_log_submit_to_slide_time=1584) [2025-04-21 14:09:39.037497] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:39.040576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=18] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43580047360, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:39.042671] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=84] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:39.064326] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215778749924000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=314391, in_cluster_service=true, cluster_version={val:1745215778249390004, v:0}, min_cluster_version={val:1745215778249390004, v:0}, max_cluster_version={val:1745215778249390004, v:0}, get_cluster_version_err=0, cluster_version_delta=814925, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1545, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=109940051, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:39.068821] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=55] PNIO [ratelimit] time: 1745215779068817, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007623, add_bytes: 0 [2025-04-21 14:09:39.080743] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=27] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:142149061, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:117, recv_lp_rpc_cnt:0, recv_mysql_cnt:1400, recv_task_cnt:149, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:527199, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:81, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:162, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:662, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x40e:cnt=8 pcode=0x152:cnt=5, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:09:39.081516] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=771] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:09:39.081551] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=33] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:11523109, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:889633, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:09:39.082188] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=636] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:09:39.082204] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=16] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:9591390, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:444782, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:09:39.082826] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=621] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:09:39.082842] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=14] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:44253834, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:155, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:69227, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:650, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:09:39.083409] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=567] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:09:39.083438] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=27] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:72977502, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:2097, recv_task_cnt:54, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:70745, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:309, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215741776438}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:1278, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=20, token_change_ts:1745215755970093, tenant_role:1}) [2025-04-21 14:09:39.084014] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=575] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:09:39.089476] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:39.094669] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.097032] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:39.097082] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.103181] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:39.103230] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=45] start lib cache evict(tenant_id=1001, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:39.103250] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:39.103274] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=22] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:39.106393] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9650, avg_group_log_size=643) [2025-04-21 14:09:39.106442] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:39.106429] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=17] Dumping All Cache Objs(alloc_obj_list.count()=156, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}, {obj_id:457, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:39.106907] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=474] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:39.107727] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] get_max_applied_scn(scn={val:1745215779008933000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65961371}, palf_committed_end_scn_:{val:1745215779008933000, v:0}, last_check_scn_:{val:1745215779008933000, v:0}, max_applied_cb_scn_:{val:1745215779008933000, v:0}}) [2025-04-21 14:09:39.107782] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65961371}, readable_log_tail:{lsn:65961371}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1143397, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:39.108252] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9650, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:39.180667] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:39.180724] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=55] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:39.181344] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] update_check_range(min_check_version=16, max_check_version=17, global_version=18) [2025-04-21 14:09:39.194740] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.205946] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=29] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 232 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 50 61 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 89 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 22 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 98 245 0 1002 2 33 1 0 1002 4 1 1 0 1002 5 21 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 24636 [2025-04-21 14:09:39.206018] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=42] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,079,066,624 rpc_hold: 0 cache_hold: 134,217,728 cache_used: 134,217,728 cache_item_count: 64 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:39.206346] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=19] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,460,544 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,792,320 used= 4,210,688 count= 71 avg_used= 59,305 block_cnt= 71 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,218,112 used= 3,084,912 count= 666 avg_used= 4,632 block_cnt= 666 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,603,840 used= 1,517,936 count= 42 avg_used= 36,141 block_cnt= 42 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 6 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 609,600 used= 595,200 count= 75 avg_used= 7,936 block_cnt= 75 chunk_cnt= 14 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 393,088 used= 377,152 count= 83 avg_used= 4,544 block_cnt= 83 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 227,584 used= 222,208 count= 28 avg_used= 7,936 block_cnt= 28 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 10,112 used= 7,395 count= 14 avg_used= 528 block_cnt= 13 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,768 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,460,544 used= 376,307,127 count= 32,204 avg_used= 11,685 mod=SUMMARY [2025-04-21 14:09:39.206401] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=38] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:09:39.206428] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=14] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:09:39.206461] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=21] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 88,452,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 83,453,440 used= 75,789,527 count= 3,772 avg_used= 20,092 block_cnt= 3,772 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,550,144 used= 3,337,968 count= 367 avg_used= 9,095 block_cnt= 367 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,447,040 used= 1,319,360 count= 665 avg_used= 1,984 block_cnt= 222 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 88,452,608 used= 80,448,455 count= 4,806 avg_used= 16,739 mod=SUMMARY [2025-04-21 14:09:39.206492] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:09:39.206517] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=17] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:09:39.206553] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 134,217,728 used= 134,217,728 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 mod=SUMMARY [2025-04-21 14:09:39.206582] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:09:39.206602] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=13] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:39.206622] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=11] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:39.206646] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:09:39.206693] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,756,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,885,696 used= 1,841,152 count= 232 avg_used= 7,936 block_cnt= 232 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,756,416 used= 19,682,880 count= 236 avg_used= 83,402 mod=SUMMARY [2025-04-21 14:09:39.206725] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=18] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:09:39.206762] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:09:39.206797] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 6,291,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 109,858,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:39.207085] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=20] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,346,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:39.393932] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.394874] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.401693] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=25] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:39.401738] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=35] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:39.401767] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=25] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=35) [2025-04-21 14:09:39.403459] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=27] ====== traversal_flush timer task ====== [2025-04-21 14:09:39.403586] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA8-0-0] [lt=47] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215779305634000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:39.403740] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA8-0-0] [lt=147] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:39.414849] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:39.414906] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:39.415084] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:39.415263] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:39.415347] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12261, [delay/us]:prepare:16, schedule:32, submit:7, rt:1278, total:1333) [2025-04-21 14:09:39.415423] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:39.415479] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12261, [delay/us]: prepare:16, schedule:32, submit:7, device:1278, total:1333) [2025-04-21 14:09:39.415547] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:39.415620] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:633, total:649) [2025-04-21 14:09:39.415695] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:39.415731] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:633, total:649) [2025-04-21 14:09:39.415789] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:39.415813] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:39.424215] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:09:39.439953] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:39.441576] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43580047360, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:39.441700] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:39.441748] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:39.441770] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:39.441794] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:39.441816] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=21] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254983991941, flush_io_finished_ret_:0, flush_io_finished_round_:171, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:39.448776] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A9-0-0] [lt=22][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.451262] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01A9-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254985001570, cache_obj->added_lc()=false, cache_obj->get_object_id()=757, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:39.451307] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:39.452271] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=34] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:39.452502] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=229] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:39.452576] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:39.452675] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=95] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:39.452718] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:39.452744] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215771299107001, v:0}) [2025-04-21 14:09:39.452762] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:39.452779] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:39.452800] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:39.452829] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:39.452851] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:39.452880] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:39.452910] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:39.452930] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:39.464716] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=97] get_max_applied_scn(scn={val:1745215779250132000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9186753}, palf_committed_end_scn_:{val:1745215779250132001, v:0}, last_check_scn_:{val:1745215779250132001, v:0}, max_applied_cb_scn_:{val:1745215779250132000, v:0}}) [2025-04-21 14:09:39.464766] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=45] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9186753}, readable_log_tail:{lsn:9186753}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57918015, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:39.474668] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=36] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:39.474738] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.475418] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.475595] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.475660] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.475882] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.489772] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=64] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:39.494952] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.506387] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00A1-0-0] [lt=99] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=398, Holding Memory(MB)=68, Tenant Remain Memory(MB)=550, Usable Remain Memory(MB)=330, Last Update Limit Timestamp=1745215779505503, Is Updated=true) [2025-04-21 14:09:39.506508] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:39.556751] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=56] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:39.583199] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:39.595022] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.597199] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:39.597251] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.603525] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:39.607749] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:39.607801] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:39.609572] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:39.609608] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:39.635881] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=92] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:39.635940] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:39.642056] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:39.646947] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=54] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:39.655503] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:39.655560] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=40] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=33) [2025-04-21 14:09:39.656315] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:39.656375] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=45] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:39.656406] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=28] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:39.656427] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=33) [2025-04-21 14:09:39.660757] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=99] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:39.660801] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=41] try gc retain ctx [2025-04-21 14:09:39.660815] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:39.660865] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215779565380000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215769557463001, v:0}, keep_alive_scn_:{val:1745215774561381001, v:0}, update_ts_:1745215779659959}) [2025-04-21 14:09:39.661812] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=35] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215787945792000, latest_log_ts:{val:1745215771299107001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:39.689909] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:39.690844] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=20] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:39.690905] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=45] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=35) [2025-04-21 14:09:39.694281] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:39.694396] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=83] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:39.694434] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=33] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=35) [2025-04-21 14:09:39.694918] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695106] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.695173] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695600] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695612] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695617] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695666] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695726] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.695759] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=45] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.696116] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=23] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.696124] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=50] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.696228] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:39.706449] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00A2-0-0] [lt=45] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965340852737426758e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.978117873357344934e+02) [2025-04-21 14:09:39.706667] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] get number(ret=0, service_type_=0, range=1, base_id=1745215779705996000, start_id=1745215779705996000, end_id=1745215779705996001) [2025-04-21 14:09:39.706797] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9763) [2025-04-21 14:09:39.726246] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDB-0-0] [lt=35] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:39.735950] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:39.736009] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:39.736043] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:39.736072] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:39.736115] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:39.736143] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:39.737836] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1461, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:39.737893] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:39.737935] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=67] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:39.737962] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1573, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:39.737980] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:39.747715] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE11-0-0] [lt=36] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:39.750876] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215779750237000, start_id=1745215779750237000, end_id=1745215779750237001) [2025-04-21 14:09:39.750981] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=70] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=414, get_gts_with_stc_cnt=65, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=64, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:39.762217] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE28-0-0] [lt=54][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.762217] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03CE-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.764425] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03D0-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.764428] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE2A-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.766766] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=104] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:39.767220] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03D1-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.769814] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03D3-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.778759] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE0F-0-0] [lt=39] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:39.795291] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=94] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:39.795335] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:39.795361] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=24][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.795695] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=46] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:39.810130] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=92] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:39.810198] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:39.811804] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:39.811961] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:39.812034] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1493, avg_log_submit_to_slide_time=1513) [2025-04-21 14:09:39.812162] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:39.812257] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:39.817991] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=33] ====== check clog disk timer task ====== [2025-04-21 14:09:39.818039] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:39.828557] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:39.839825] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:39.840419] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:39.840468] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:39.840487] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:39.840508] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:39.840526] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254984390636, flush_io_finished_ret_:0, flush_io_finished_round_:171, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:39.842632] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=57] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:39.851845] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=45] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=5200000, clean_num=200000) [2025-04-21 14:09:39.870540] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=39] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65964198}, readable_log_tail:{lsn:65964198}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1140570, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:39.870673] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=131] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:09:39.870732] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=33] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:39.881202] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=22] Garbage Collector is running(seq_=18, gc_interval=10000000) [2025-04-21 14:09:39.881278] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=42] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:39.881313] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=26] gc_check_member_list_ cost time(ret=0, time_us=67) [2025-04-21 14:09:39.881346] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=25] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:39.881371] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=18] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:39.881396] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:39.881418] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=24) [2025-04-21 14:09:39.881432] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=11] ObSafeDestroyHandler start process [2025-04-21 14:09:39.883595] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:09:39.894047] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:39.894103] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.894930] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8200000, replace_num=100000) [2025-04-21 14:09:39.894974] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:39.895233] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:39.897927] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=47] finish to resize log external storage handler(current_ts=1745215779897921, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:39.908323] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF4-0-0] [lt=31] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215779908298}) [2025-04-21 14:09:39.908406] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF4-0-0] [lt=53] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215779908398}) [2025-04-21 14:09:39.908400] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE46-0-0] [lt=26] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779908372, sql_renew_time:1745215779908372, is_mark_fail:false}]) [2025-04-21 14:09:39.908500] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE46-0-0] [lt=99] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215779908298}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779908372, sql_renew_time:1745215779908372, is_mark_fail:false}]) [2025-04-21 14:09:39.908558] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE47-0-0] [lt=46] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:39.909046] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE47-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779909034, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:39.909083] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE47-0-0] [lt=35] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215779908398}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779909034, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:39.910093] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF4-0-0] [lt=35] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:39.915825] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] ls blacklist refresh finish(cost_time=8848) [2025-04-21 14:09:39.918021] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=35][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:39.918122] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:39.918654] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=63] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:39.920276] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=44] blacklist_loop exec finished(cost_time=22, is_enabled=true, send_cnt=0) [2025-04-21 14:09:39.939705] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:39.939773] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=61] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:39.939803] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=26] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:39.939841] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=36] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:39.943914] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=27] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:39.945355] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=1436] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:39.946255] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03D5-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.948000] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03D7-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:39.952808] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=3656, avg_group_log_size=332) [2025-04-21 14:09:39.954265] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1395, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:39.954326] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=45, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:39.954387] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:39.954440] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1544, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:39.954468] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:39.963011] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE48-0-0] [lt=19] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:39.963515] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE48-0-0] [lt=38] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779963490, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:39.963563] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE48-0-0] [lt=47] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215779962936}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215779963490, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:39.968073] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1444, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:39.968127] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:39.968185] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:39.968235] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1558, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:39.968251] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=1518, avg_log_submit_to_slide_time=1536) [2025-04-21 14:09:39.968289] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:39.969937] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE13-0-0] [lt=39] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:39.970017] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE15-0-0] [lt=35] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:39.974923] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:39.975014] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=82] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:39.992584] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215779992579, bytes: 5320792, bw: 0.014395 MB/s, add_ts: 1007618, add_bytes: 15209 [2025-04-21 14:09:39.995318] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.002950] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=42] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15060, max_lsn:65964320, max_scn:{val:1745215779809389001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:65964320}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:65964198}, last_submit_end_lsn:{lsn:65964320}, last_submit_log_id:15060, last_submit_log_pid:3, max_flushed_lsn:{lsn:65964198}, max_flushed_end_lsn:{lsn:65964320}, max_flushed_log_pid:3, committed_end_lsn:{lsn:65964320}, last_slide_log_id:15060, last_slide_scn:{val:1745215779809389001, v:0}, last_slide_lsn:{lsn:65964198}, last_slide_end_lsn:{lsn:65964320}, last_slide_log_pid:3, last_slide_log_accum_checksum:3838797951, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15061, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:65964320}, readable_log_tail:{lsn:65964320}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1140448, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:09:40.003206] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=248] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215779954359, last_flushed_end_lsn:{lsn:65964320}}]) [2025-04-21 14:09:40.003232] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=22] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15061, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215779954359, last_flushed_end_lsn:{lsn:65964320}}]) [2025-04-21 14:09:40.011933] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215779809389000, v:0}, new_max_version={val:1745215779809389000, v:0}, last_min_version={val:1745215779609376000, v:0}, last_max_version={val:1745215779609376000, v:0}, total_time_us=3461, delta_us=202541) [2025-04-21 14:09:40.011984] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215779809389000, v:0}, min_version={val:1745215779809389000, v:0}, max_version={val:1745215779809389000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:40.019584] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03DA-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.020411] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03DB-0-0] [lt=55][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.037979] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1493, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:40.038036] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:40.038016] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:40.038091] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:40.038143] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:40.038168] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1620, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:40.038187] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1573, avg_log_submit_to_slide_time=1593) [2025-04-21 14:09:40.038224] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:40.038261] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1559, avg_log_submit_to_slide_time=1577) [2025-04-21 14:09:40.038304] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:40.042817] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=53] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:40.052381] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=34] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:40.061507] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=20] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:40.061616] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=68] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:40.061654] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=284, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:40.061727] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=27] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:40.061793] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:40.061815] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=20] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=30, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:40.071884] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:09:40.071928] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=43] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:09:40.076467] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215780076452, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007635, add_bytes: 0 [2025-04-21 14:09:40.095083] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:40.095370] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.097370] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:40.097424] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.103018] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=38] LogLoopThread round_cost_time(us)(round_cost_time=346) [2025-04-21 14:09:40.107354] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7886, avg_group_log_size=606) [2025-04-21 14:09:40.107404] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:40.109311] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8475) [2025-04-21 14:09:40.109399] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8475) [2025-04-21 14:09:40.109495] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7886, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:40.127055] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=51] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:40.137206] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620213][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=81] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1001, is_allowed_broadcast=true) [2025-04-21 14:09:40.138063] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=16] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=25, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:40.138116] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=51] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1520, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:40.138148] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=31] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:40.138175] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=25] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-585, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:40.138201] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F03A5-0-0] [lt=25] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=961, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:40.152399] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFE26-0-0] [lt=45][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:09:40.170064] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=61] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:40.190444] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=46] BlockGCTimerTask success(ret=0, cost_time_us=33, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:40.195437] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.211293] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=52][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:40.237711] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:40.237836] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:40.237927] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:40.251448] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:40.252901] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=70] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:40.295227] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:40.295461] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.305545] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215780106851000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198677, in_cluster_service=true, cluster_version={val:1745215779905616000, v:0}, min_cluster_version={val:1745215779905616000, v:0}, max_cluster_version={val:1745215779905616000, v:0}, get_cluster_version_err=0, cluster_version_delta=399912, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1557, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=115126121, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:40.308260] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4127, offset=94671}, end_cursor:ObLogCursor{file_id=3, log_id=4128, offset=94977}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7784c050, len:3633, log_data_len:306, seq:4127, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:40.308767] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE88-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:40.308835] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE88-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215779750237004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215779750237004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:40.312505] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE88-0-0] [lt=41] get number(ret=0, service_type_=0, range=1, base_id=1745215780311735000, start_id=1745215780311735000, end_id=1745215780311735001) [2025-04-21 14:09:40.315333] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=197] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4128, offset=94977}, end_cursor:ObLogCursor{file_id=3, log_id=4129, offset=95274}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77850050, len:3327, log_data_len:297, seq:4128, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:40.315669] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE88-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:40.315741] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE88-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215779750237004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215779750237004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:40.333037] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE25-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:40.333081] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE25-0-0] [lt=41] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:40.353142] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:09:40.394218] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:40.394283] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=56] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.395530] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.406202] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:40.408091] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] get number(ret=0, service_type_=0, range=1, base_id=1745215780407587000, start_id=1745215780407587000, end_id=1745215780407587001) [2025-04-21 14:09:40.411216] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:40.411266] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:40.416861] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:40.416923] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:40.417116] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:40.417301] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:40.417386] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:34, schedule:47, submit:10, rt:1539, total:1631) [2025-04-21 14:09:40.417471] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:40.417537] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:34, schedule:47, submit:10, device:1539, total:1631) [2025-04-21 14:09:40.417592] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:40.417664] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:553, total:575) [2025-04-21 14:09:40.417743] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:40.417781] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:553, total:575) [2025-04-21 14:09:40.417843] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:40.417870] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:40.424305] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:40.440112] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:40.448680] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:40.453394] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:40.455324] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01AB-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.457762] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01AB-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254986008070, cache_obj->added_lc()=false, cache_obj->get_object_id()=758, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:40.463350] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:40.464602] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:40.464703] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215771218295000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:40.474984] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.475194] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:40.475276] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=73] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.475504] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.475726] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.475964] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.495374] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:40.495615] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.573790] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:40.573844] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:40.583275] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:40.593215] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=55] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:40.593269] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=44] temporary file module use no blocks [2025-04-21 14:09:40.593286] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:40.593307] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:40.593332] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254985143437, flush_io_finished_ret_:0, flush_io_finished_round_:172, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:40.595690] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.597542] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:40.597591] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.603675] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:40.608299] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:40.608350] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:40.610206] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:40.610247] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:40.636808] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:40.636908] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=82] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:40.639998] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=17] ====== tenant freeze timer task ====== [2025-04-21 14:09:40.640064] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=55] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:40.640109] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:40.653911] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:40.693883] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=136] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:40.694918] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695108] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695157] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=54] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:40.695177] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695266] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215775613757000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:40.695387] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695393] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695523] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:40.695544] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695568] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695695] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.695781] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.695955] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.696093] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:40.707351] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00A7-0-0] [lt=91] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:40.707673] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=76] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:09:40.720929] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=26] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:40.720978] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=45] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:09:40.720997] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=18] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:40.721029] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [619840][T1_SSTableDefra][T1][Y0-0000000000000000-0-0] [lt=28] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:40.736847] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:40.736941] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:40.736973] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:40.736998] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:40.737065] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:40.737085] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:40.738400] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1371, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:40.738445] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:40.738484] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:40.738509] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1504, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:40.738526] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=11] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:40.740544] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01AD-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.743104] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01AD-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254986293411, cache_obj->added_lc()=false, cache_obj->get_object_id()=759, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:40.744514] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B1-0-0] [lt=42][errcode=-4201] hashtable not init [2025-04-21 14:09:40.744551] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B1-0-0] [lt=36] get cursor info failed(cursor_id=51, get_sessid()=3221487630) [2025-04-21 14:09:40.744698] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1745215780744193000, start_id=1745215780744193000, end_id=1745215780744193001) [2025-04-21 14:09:40.752239] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=60] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215780752215], gts:1745215780751648000, latest_srr:[mts=1745215780752215]}) [2025-04-21 14:09:40.765655] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03DD-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.765661] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE2B-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.767530] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:40.767796] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03DF-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.768756] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03E1-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.770739] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03E2-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.772502] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03E4-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.789779] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=105] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:40.795808] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=42] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:40.795833] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.810834] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=99] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:40.810902] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:40.812449] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4517) [2025-04-21 14:09:40.812558] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4517) [2025-04-21 14:09:40.812620] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1560, avg_log_submit_to_slide_time=1580) [2025-04-21 14:09:40.812742] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4517, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:40.828679] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:40.838486] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17418399, this={dio_aligned_buf:{buf_write_offset:2329, buf_padding_size:1767, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3561, truncate_used_ts:1399}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17416192, buf_len=122, total_write_size=15480, total_write_size_after_dio=425984, ob_pwrite_used_ts=163288, count=100, each_pwrite_cost=1632) [2025-04-21 14:09:40.840007] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:40.840646] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:40.840700] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:40.840727] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:40.840754] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:40.840778] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254985390880, flush_io_finished_ret_:0, flush_io_finished_round_:172, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:40.852616] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=92] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:40.854467] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=76] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:40.894401] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:40.894471] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.895661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:40.895902] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:40.911035] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=106] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:40.925991] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=73] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:40.949340] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03E6-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.951226] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03E8-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:40.953572] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=67] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4517, avg_group_log_size=410) [2025-04-21 14:09:40.955061] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=50] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1456, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:40.955111] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:40.955174] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:40.955217] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1609, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:40.955244] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:40.966673] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=44] current monitor number(seq_=-1) [2025-04-21 14:09:40.969103] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1785, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:40.969158] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:40.969239] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:40.969286] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1918, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:40.969308] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=23, avg_log_submit_to_flush_time=1873, avg_log_submit_to_slide_time=1894) [2025-04-21 14:09:40.969354] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:40.975434] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:40.975526] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=84] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:40.992503] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=80] LogLoopThread round_cost_time(us)(round_cost_time=27) [2025-04-21 14:09:40.995985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.000185] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=49] PNIO [ratelimit] time: 1745215781000181, bytes: 5333564, bw: 0.012088 MB/s, add_ts: 1007602, add_bytes: 12772 [2025-04-21 14:09:41.011177] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1745215781010460000, start_id=1745215781010460000, end_id=1745215781010460001) [2025-04-21 14:09:41.013249] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215780810652000, v:0}, new_max_version={val:1745215780810652000, v:0}, last_min_version={val:1745215780610513000, v:0}, last_max_version={val:1745215780610513000, v:0}, total_time_us=3856, delta_us=202594) [2025-04-21 14:09:41.013298] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215780810652000, v:0}, min_version={val:1745215780810652000, v:0}, max_version={val:1745215780810652000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:41.013335] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=28] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:41.024221] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03EB-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.026332] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03EC-0-0] [lt=53][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.029996] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=37] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:41.030114] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=44] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:41.035799] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=41] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:41.037170] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=31] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:41.037210] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=39] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:41.037243] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC6-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:41.037285] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC6-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:41.038673] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:41.038765] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1453, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:41.038809] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:41.038825] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=17, avg_log_submit_to_flush_time=1453, avg_log_submit_to_slide_time=1478) [2025-04-21 14:09:41.038902] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:41.038943] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:41.038966] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1599, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:41.038980] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=14, avg_log_gen_to_submit_time=43, avg_log_submit_to_flush_time=1542, avg_log_submit_to_slide_time=1556) [2025-04-21 14:09:41.038998] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:41.039045] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:41.040653] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=25] === Run print tenant memory usage task === [2025-04-21 14:09:41.040736] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=44] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 136,462,336 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,781,040,437 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,079,066,624 max_mem_memstore_can_get_now= 2,458,828,800 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,781,040,437 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 71,514,920 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 555,724,800 max_mem_memstore_can_get_now= 357,574,616 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,781,040,437 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 61,686,560 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 664,494,080 max_mem_memstore_can_get_now= 308,432,866 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:41.040824] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=18] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,224,395,776 total_hold= 3,395,289,088 used= 3,142,402,048 freelists_hold= 81,993,728 total_maps= 1,224 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,911,827,456 divisive_memory_used= 136,462,336 virtual_memory_used= 4,601,102,336 [CHUNK_MGR] 2 MB_CACHE: hold= 33,554,432 free= 16 pushes= 341,418 pops= 341,402 maps= 1,090 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 169 pops= 167 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:41.040868] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=23] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 3900, delta_count= 3, avg_cost_time= 1300 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:41.042979] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=77] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:41.055003] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:41.059164] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE8B-0-0] [lt=39] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.064725] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=39] check new jobs(ret=0, tenant_id=1002, is_oracle_tenant=false, job_infos=[{tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215776375329, start_date_:1745214971149911, last_date_:1745215176239399, this_date_:0, next_date_:1745215871149911, end_date_:64060560000000000, total_:600135930, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745300471149799, last_date_:0, this_date_:0, next_date_:1745300471149799, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1002, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745214071158158, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:41.064945] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620330][T1002_DBMSSched][T1002][Y0-0000000000000000-0-0] [lt=216] check all tenants(ret=0) [2025-04-21 14:09:41.066412] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE8F-0-0] [lt=22] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.067177] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD96-0-0] [lt=55] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:41.068334] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE90-0-0] [lt=36] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.070415] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE91-0-0] [lt=48] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.072029] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] [COMPACTION DAG STATUS] (start_time=1745215771068684, end_time=1745215781072026, dag_status={}) [2025-04-21 14:09:41.072070] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=38] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072100] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072100] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE92-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.072119] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072137] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072169] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072186] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072204] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072221] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:41.072239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072263] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072301] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072319] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072336] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072354] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072372] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072390] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072408] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072425] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072443] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072460] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072478] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072496] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072514] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072532] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072549] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072605] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072623] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072652] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072671] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072689] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072715] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072733] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072746] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072764] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072782] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072818] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072870] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072888] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072905] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072923] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072941] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072959] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.072986] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073020] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=34] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073041] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073059] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073077] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073095] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073130] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073147] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073165] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073182] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073200] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073217] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073235] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073252] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073288] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073308] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073325] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073342] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073377] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073422] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073440] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073459] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073477] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073495] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073531] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:41.073550] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:41.073568] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:41.073586] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:41.073603] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:41.073620] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:41.073636] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:41.073633] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE93-0-0] [lt=21] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.073651] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:41.073667] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:41.073682] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:41.073697] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:41.073714] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:41.075104] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE94-0-0] [lt=21] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.077104] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620330][T1002_DBMSSched][T1002][YB420B1D7AB6-00063343B54EFE95-0-0] [lt=54] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:41.084038] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=59] PNIO [ratelimit] time: 1745215781084033, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007581, add_bytes: 0 [2025-04-21 14:09:41.095800] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:41.096059] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.097698] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:41.097750] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.107809] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7773, avg_group_log_size=647) [2025-04-21 14:09:41.107863] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:41.109644] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7773) [2025-04-21 14:09:41.109733] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7773) [2025-04-21 14:09:41.109838] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7773, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:41.137062] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] success to update min reserved snapshot(reserved_snapshot=1745213971218295000, duration=1800, snapshot_gc_ts=1745215771218295000) [2025-04-21 14:09:41.139321] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=77] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=9192801, this={dio_aligned_buf:{buf_write_offset:1499, buf_padding_size:2597, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4432, truncate_used_ts:1850}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=9191424, buf_len=122, total_write_size=13304, total_write_size_after_dio=417792, ob_pwrite_used_ts=155283, count=99, each_pwrite_cost=1568) [2025-04-21 14:09:41.139617] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=54] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213971218295000) [2025-04-21 14:09:41.140390] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] submit reserved snapshot log success(ls_id={id:1001}, new_snapshot_version=1745213971218295000) [2025-04-21 14:09:41.140431] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=38] update reserved snapshot finished(cost_ts=3375, reserved_snapshot=1745213971218295000) [2025-04-21 14:09:41.152629] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=21] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:41.152732] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=96] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:41.152755] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:41.152781] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:41.156259] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=26] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}, {obj_id:303, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:304, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:41.156620] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=355] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:41.196129] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.205270] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=43] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:41.206614] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=49] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:41.206658] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=40] no transfer partition job [2025-04-21 14:09:41.206692] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=21] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:41.209238] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=27] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:41.209298] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=46] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:41.209340] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD96-0-0] [lt=35] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:41.238497] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1332) [2025-04-21 14:09:41.252555] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=57] ts response task statistics(alloc_count=3894, free_count=1946) [2025-04-21 14:09:41.252626] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=56] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:41.255511] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:41.262769] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD9-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:41.262817] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDD9-0-0] [lt=39] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=50) [2025-04-21 14:09:41.295926] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:41.296222] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.308207] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00AA-0-0] [lt=19] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=95) [2025-04-21 14:09:41.308493] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] submit log success(service_type_=0, last_id=1745215797945792000, limited_id=1745215797945792000) [2025-04-21 14:09:41.308527] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] submit log with lock success(service_type_=0, last_id=1745215797945792000, limited_id=1745215797945792000) [2025-04-21 14:09:41.310357] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] update id meta(ret=0, service_type=0, limited_id=1745215797945792000, latest_scn={val:1745215781308321001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:41.310467] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=109] handle submit callback(service_type_=0, success=true, used_ts=1975, log_ts={val:1745215781308321001, v:0}, limited_id=1745215797945792000) [2025-04-21 14:09:41.310490] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=21] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:41.310506] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=16] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:41.311994] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215781311540000, start_id=1745215781311540000, end_id=1745215781311540001) [2025-04-21 14:09:41.321849] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=67] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4129, offset=95274}, end_cursor:ObLogCursor{file_id=3, log_id=4130, offset=95580}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77854050, len:3030, log_data_len:306, seq:4129, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:41.322243] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE89-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:41.322312] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE89-0-0] [lt=47] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215781228971000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215781228971000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:41.329839] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=60] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4130, offset=95580}, end_cursor:ObLogCursor{file_id=3, log_id=4131, offset=95877}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77858050, len:2724, log_data_len:297, seq:4130, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:41.330169] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE89-0-0] [lt=54] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:41.330242] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE89-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215781228971000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215781228971000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:41.335990] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE26-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:41.336069] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE26-0-0] [lt=77] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:41.353872] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4516) [2025-04-21 14:09:41.368138] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215781367402000, start_id=1745215781367402000, end_id=1745215781367402001) [2025-04-21 14:09:41.394604] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:41.394677] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=64] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.396305] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.419142] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:41.419279] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=108] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:41.419525] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:41.419828] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=78] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:41.419979] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8171, [delay/us]:prepare:24, schedule:56, submit:11, rt:1393, total:1485) [2025-04-21 14:09:41.420151] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:41.420355] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=176] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8169, [delay/us]: prepare:24, schedule:56, submit:11, device:1393, total:1485) [2025-04-21 14:09:41.420522] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:41.420655] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4083, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:634, total:649) [2025-04-21 14:09:41.420779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:41.420860] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=72] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4083, [delay/us]: prepare:0, schedule:0, submit:600000000, device:634, total:649) [2025-04-21 14:09:41.420987] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=60] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:41.421076] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=54] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:41.424396] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:41.439268] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2147) [2025-04-21 14:09:41.439560] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=2147, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:41.440284] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:41.442044] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=37] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:41.442157] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=90] temporary file module use no blocks [2025-04-21 14:09:41.442204] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:41.442239] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=29] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:41.442273] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=31] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254985992251, flush_io_finished_ret_:0, flush_io_finished_round_:173, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:41.456057] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:41.461961] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B3-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.464411] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B3-0-0] [lt=41][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254987014717, cache_obj->added_lc()=false, cache_obj->get_object_id()=760, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:41.475604] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.475604] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.475676] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.475723] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:41.475824] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=91] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.476042] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.496061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:41.496383] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.515938] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=66] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:41.566512] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=45] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215781228971000, v:0}, base_version={val:1745215780751648004, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215781228971000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215781566480, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:41.583361] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=64] gc stale ls task succ [2025-04-21 14:09:41.593482] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:41.593574] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=79] temporary file module use no blocks [2025-04-21 14:09:41.593611] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=34] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:41.593657] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=41] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:41.593698] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=38] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254986143694, flush_io_finished_ret_:0, flush_io_finished_round_:173, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:41.596476] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.597897] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:41.597962] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.603838] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:41.604423] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:41.606125] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] get number(ret=0, service_type_=0, range=1, base_id=1745215781605550000, start_id=1745215781605550000, end_id=1745215781605550001) [2025-04-21 14:09:41.608431] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:41.608486] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:41.610259] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:41.610297] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:41.627744] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=20] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:41.627833] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=79] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:41.627854] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=17] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:41.627884] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=27] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:41.630573] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=39] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:41.632241] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=40] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:41.633707] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=39] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:41.633747] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=38] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:41.635051] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=16] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:41.635151] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=39] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:41.635180] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:41.637633] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:41.637718] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:41.639490] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=19] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:41.640983] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:41.641033] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=48] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:41.642331] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:41.642435] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=37] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:41.642462] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:41.646804] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=23] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:41.648277] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=39] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:41.648315] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=37] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:41.649633] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:41.649745] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:41.649774] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=26] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:41.649810] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=24] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:41.649878] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=60] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:41.649900] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=21] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:41.649932] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=29] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:41.649959] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=26] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:41.649976] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=12] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:41.649987] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=11] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:41.650014] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:41.650033] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=18] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:41.650054] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=17] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:41.650072] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=18] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:41.650099] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=24] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:41.650122] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:41.651331] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=12] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:41.651372] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=39] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:41.651389] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:41.651429] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=19] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:41.651457] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=27] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:41.651473] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=14] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:41.651493] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=16] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:41.651521] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD98-0-0] [lt=27] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:41.656656] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:41.656931] INFO [COMMON] wash (ob_kvcache_store.cpp:356) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash time detail, (compute_wash_size_time=160, refresh_score_time=44, wash_time=0) [2025-04-21 14:09:41.675231] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B7-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.675881] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01B8-0-0] [lt=58] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11039, add_timestamp:1745215781675864}) [2025-04-21 14:09:41.675911] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE49-0-0] [lt=22] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11039, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:41.676326] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE49-0-0] [lt=38] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11039, locations=[{table_id:11039, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781676303, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:41.676372] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE49-0-0] [lt=43] success to process renew task(task={tenant_id:1, table_id:11039, add_timestamp:1745215781675864}, locations=[{table_id:11039, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781676303, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:41.677561] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01BA-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.681381] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01BD-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.685511] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01C0-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.686591] WDIAG [LIB.TIME] str_to_digit_with_date (ob_time_convert.cpp:1928) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=49][errcode=-4219] datetime format too short(ret=-4219, str=0) [2025-04-21 14:09:41.686640] WDIAG [LIB.TIME] str_to_ob_time_with_date (ob_time_convert.cpp:1990) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=47][errcode=-4219] failed to get digits(ret=-4219, str=0) [2025-04-21 14:09:41.686666] WDIAG [LIB.TIME] str_to_datetime (ob_time_convert.cpp:398) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=25][errcode=-4219] failed to convert string to datetime(ret=-4219) [2025-04-21 14:09:41.686753] WDIAG [LIB.TIME] str_to_digit_with_date (ob_time_convert.cpp:1928) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=38][errcode=-4219] datetime format too short(ret=-4219, str=0) [2025-04-21 14:09:41.686783] WDIAG [LIB.TIME] str_to_ob_time_with_date (ob_time_convert.cpp:1990) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=28][errcode=-4219] failed to get digits(ret=-4219, str=0) [2025-04-21 14:09:41.686807] WDIAG [LIB.TIME] str_to_datetime (ob_time_convert.cpp:398) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD1-0-0] [lt=23][errcode=-4219] failed to convert string to datetime(ret=-4219) [2025-04-21 14:09:41.688169] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01C2-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.688661] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01C3-0-0] [lt=33] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11001, add_timestamp:1745215781688642}) [2025-04-21 14:09:41.688697] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4A-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11001, vtable_type={tenant_id:1, type:2}) [2025-04-21 14:09:41.689195] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4A-0-0] [lt=44] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11001, locations=[{table_id:11001, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781689165, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:41.689254] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4A-0-0] [lt=57] success to process renew task(task={tenant_id:1, table_id:11001, add_timestamp:1745215781688642}, locations=[{table_id:11001, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781689165, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:41.689873] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01C5-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.691163] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F0-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.691572] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F1-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.694056] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F3-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.694507] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F4-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.694772] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.694799] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695260] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695267] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695327] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695332] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695438] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=22] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695519] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695627] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.695904] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.696048] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=30] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:41.696215] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=57] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:41.696432] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01C9-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.696533] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.700982] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01CC-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.708077] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00AC-0-0] [lt=20] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:41.708423] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01CF-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.708437] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8416) [2025-04-21 14:09:41.709241] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D0-0-0] [lt=43] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12095, add_timestamp:1745215781709212}) [2025-04-21 14:09:41.709317] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D0-0-0] [lt=48] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12450, add_timestamp:1745215781709310}) [2025-04-21 14:09:41.709322] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4B-0-0] [lt=41] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12095, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781709296, sql_renew_time:1745215781709296, is_mark_fail:false}]) [2025-04-21 14:09:41.709378] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4B-0-0] [lt=54] success to process renew task(task={tenant_id:1, table_id:12095, add_timestamp:1745215781709212}, locations=[{table_id:12095, partition_id:12095, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781709296, sql_renew_time:1745215781709296, is_mark_fail:false}]) [2025-04-21 14:09:41.709428] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4C-0-0] [lt=30] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12450, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781709418, sql_renew_time:1745215781709418, is_mark_fail:false}]) [2025-04-21 14:09:41.709454] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4C-0-0] [lt=26] success to process renew task(task={tenant_id:1, table_id:12450, add_timestamp:1745215781709310}, locations=[{table_id:12450, partition_id:12450, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215781709418, sql_renew_time:1745215781709418, is_mark_fail:false}]) [2025-04-21 14:09:41.720769] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D2-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.731477] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDC-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:41.732944] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D5-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.737705] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:41.737796] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=2327, avg_group_log_size=232) [2025-04-21 14:09:41.737841] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2327) [2025-04-21 14:09:41.737871] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:41.737919] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:41.737899] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D6-0-0] [lt=37][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=48, bitmap=NULL) [2025-04-21 14:09:41.737948] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:41.739889] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=105] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1433, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:41.739946] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:41.739997] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:41.740024] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1588, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:41.740048] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:41.741649] WDIAG begin (ob_hashtable.h:954) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD2-0-0] [lt=21][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.743718] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D8-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.745096] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD2-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254987295397, cache_obj->added_lc()=false, cache_obj->get_object_id()=761, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:41.748887] WDIAG [RPC.OBMYSQL] serialize (ob_mysql_row.cpp:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01D9-0-0] [lt=54][errcode=-4019] failed to encode cell(ret=-4019, cell_idx=2, len=49, pos=48, bitmap=NULL) [2025-04-21 14:09:41.753077] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=22] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215781753063], gts:1745215781752429000, latest_srr:[mts=1745215781753063]}) [2025-04-21 14:09:41.757823] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01DB-0-0] [lt=60][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.762736] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01DE-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.765480] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01E2-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.768434] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:41.768858] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F6-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.769493] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03F7-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.769989] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01E5-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.771154] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE2D-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.771173] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03FA-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.773319] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03FC-0-0] [lt=56][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.773598] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F03FD-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.774613] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01E8-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.774946] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0400-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.776984] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01EB-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.778039] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=20] get number(ret=0, service_type_=0, range=1, base_id=1745215781777232000, start_id=1745215781777232000, end_id=1745215781777232001) [2025-04-21 14:09:41.779861] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01EF-0-0] [lt=62][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.780785] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0403-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.782367] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F2-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.795925] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:41.796612] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.806204] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [619992][T1_CompactionRe][T1][YB420B1D7AB6-00063343B7AEFD8B-0-0] [lt=51] InfoPoolResizeTask(cost_ts=25) [2025-04-21 14:09:41.812071] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:41.812137] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:41.812994] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=20] ====== traversal_flush timer task ====== [2025-04-21 14:09:41.813134] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA9-0-0] [lt=70] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:41.813273] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDA9-0-0] [lt=130] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:41.813901] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:41.814089] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:41.814159] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1728, avg_log_submit_to_slide_time=1753) [2025-04-21 14:09:41.814295] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:41.818157] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:41.818212] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:41.820603] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:41.821888] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=38] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:41.821984] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215778810123000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:41.824400] INFO [ARCHIVE] do_thread_task_ (ob_archive_timer.cpp:130) [619988][T1_ArcTimer][T1][YB420B1D7AB6-00063343AC8EFD86-0-0] [lt=39] archive round not in doing status, just skip(key={incarnation:-1, dest_id:-1, round:-1}, state={status:"INVALID"}) [2025-04-21 14:09:41.828772] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:41.840178] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:41.840914] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:41.840972] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:41.840990] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:41.841038] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=44] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:41.841066] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254986391137, flush_io_finished_ret_:0, flush_io_finished_round_:173, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:41.849350] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:41.849517] WDIAG read_multi_row (ob_table_access_helper.h:238) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=57][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:41.851159] INFO delete_row (ob_table_access_helper.h:312) [619963][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=32] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215781849551) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215781849551) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:41.857386] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=28] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:41.857601] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:41.859288] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=44] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:41.859370] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=80] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:41.859466] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=51] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:41.859614] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=142] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:41.859676] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=51] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:41.859711] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] get rec log scn(service_type_=0, rec_log_ts={val:1745215778608332001, v:0}) [2025-04-21 14:09:41.859737] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:41.859761] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:41.859791] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:41.859835] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:41.859869] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:41.859911] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=30][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:41.859957] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=45] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:41.859986] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:41.865131] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=43] clear dtl interm result cost(us)(clear_cost=3009, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:41.865935] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=46][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:41.867891] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=43] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=5400000, clean_num=200000) [2025-04-21 14:09:41.885340] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:41.891424] INFO [ARCHIVE] produce_log_fetch_task_ (ob_archive_sequencer.cpp:171) [619985][T1_ArcSeq][T1][YB420B1D7AB6-00063343AC5EFD86-0-0] [lt=46] archive round not in doing status, just skip(key={incarnation:-1, dest_id:-1, round:-1}, state={status:"INVALID"}) [2025-04-21 14:09:41.894797] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=33] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:41.894876] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.896334] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:41.896680] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:41.926497] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=44] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:41.952320] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0405-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.954087] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0407-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:41.954394] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:41.955941] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=110] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1613, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:41.956001] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:41.956066] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:41.956126] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=58] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1788, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:41.956171] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:41.956227] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=29] [APPLY STAT CB APPEND COST TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=60, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:41.956261] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=32] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=1739, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:41.956286] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=23] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:41.956310] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=23] [APPLY STAT CB EXECUTE TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=-538, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:41.956335] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01B2-0-0] [lt=23] [APPLY STAT CB TOTAL TIME](cur_stat_count=47, stat_interval=5000000, avg (count/cost)=1261, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:41.970082] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1528, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:41.970143] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=66, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:41.970203] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:41.970230] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1800, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:41.970250] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=14, avg_log_gen_to_freeze_time=125, avg_log_gen_to_submit_time=143, avg_log_submit_to_flush_time=1636, avg_log_submit_to_slide_time=1656) [2025-04-21 14:09:41.970292] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:41.975927] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:41.975980] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:41.986588] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=40] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:41.996756] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.007808] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1745215782007802, bytes: 5348773, bw: 0.014395 MB/s, add_ts: 1007621, add_bytes: 15209 [2025-04-21 14:09:42.013785] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215781811693000, v:0}, new_max_version={val:1745215781811693000, v:0}, last_min_version={val:1745215781610902000, v:0}, last_max_version={val:1745215781610902000, v:0}, total_time_us=3541, delta_us=202088) [2025-04-21 14:09:42.013842] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215781811693000, v:0}, min_version={val:1745215781811693000, v:0}, max_version={val:1745215781811693000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:42.029884] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F040A-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.030464] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F040B-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.039344] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1566, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:42.039401] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:42.039456] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2327) [2025-04-21 14:09:42.039519] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:42.039539] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1955, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:42.039553] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=229, avg_log_gen_to_submit_time=258, avg_log_submit_to_flush_time=1668, avg_log_submit_to_slide_time=1697) [2025-04-21 14:09:42.039593] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=61, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:42.039642] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1831) [2025-04-21 14:09:42.039697] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1559, avg_log_submit_to_slide_time=1579) [2025-04-21 14:09:42.039727] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=140] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1831, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:42.043108] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=44] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:42.048072] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=197] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:42.068385] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=44] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:42.091668] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215782091661, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007628, add_bytes: 0 [2025-04-21 14:09:42.096839] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=73][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.098090] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:42.098151] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=52] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.102027] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8300000, replace_num=100000) [2025-04-21 14:09:42.102076] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:42.108810] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8416, avg_group_log_size=601) [2025-04-21 14:09:42.108864] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:42.110576] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8416) [2025-04-21 14:09:42.110676] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8416) [2025-04-21 14:09:42.110804] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8416, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:42.154467] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=79] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:42.154538] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=68] try gc retain ctx [2025-04-21 14:09:42.154561] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] try to retry start_working [2025-04-21 14:09:42.154645] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=32] finish update min start scn(max_decided_scn={val:1745215782011153000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215772003323001, v:0}, keep_alive_scn_:{val:1745215777007108001, v:0}, update_ts_:1745215782153817}) [2025-04-21 14:09:42.156284] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=62] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:42.165532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=26] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000) [2025-04-21 14:09:42.165586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=53] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.165672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.165752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.165822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.165890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.165974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.166958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167681] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167813] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.167948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168014] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168760] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.168950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.169991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170255] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170515] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.170988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171421] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171904] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.171970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172099] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.172966] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173394] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.173983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.174982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846986}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846977}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175837] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.175971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176361] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.176948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177626] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.177970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.178985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179451] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846980}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.179889] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:42.179973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.180942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101017}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181889] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.181955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182280] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.182942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183289] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183744] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.183939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184068] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.184971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185314] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.185971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186037] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186364] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186429] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.186956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187148] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.187937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60320}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188264] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200010}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.188988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189341] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.189988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190115] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190180] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190244] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.190962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191818] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191886] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.191950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846979}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192016] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192337] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.192985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.193987] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846988}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194714] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.194940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195459] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60128}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.195995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196575] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:140}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.196927] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.196970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.197956] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198020] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.198951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199018] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199082] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199539] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60395}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.199990] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200119] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200310] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.200950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201289] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201746] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.201945] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.202988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846985}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846978}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101016}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.203965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204031] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846993}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204614] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.204940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60219}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60155}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.205937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.206992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207123] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207134] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=20] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215782107776000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215782207056}, version_delta=99354) [2025-04-21 14:09:42.207188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207254] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207764] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.207960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208480] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:502}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.208933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209281] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101015}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209740] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.209996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210190] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210400] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215782011153000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199237, in_cluster_service=true, cluster_version={val:1745215781811693000, v:0}, min_cluster_version={val:1745215781811693000, v:0}, max_cluster_version={val:1745215781811693000, v:0}, get_cluster_version_err=0, cluster_version_delta=398697, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1610, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=119740527, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:42.210445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210871] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.210997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:256}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101008}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.211974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212042] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212685] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.212942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50129}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.213997] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=63] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:42.214079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846987}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214468] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60118}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.214934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215001] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215259] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215842] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.215970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:116}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216099] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216231] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216622] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.216944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217670] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.217991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:200007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.218980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846981}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219179] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219703] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219897] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.219962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220026] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50453}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220090] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220478] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220541] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220606] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220669] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220799] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.220992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60445}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.221976] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222701] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60141}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222899] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.222963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846996}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223685] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.223946] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846991}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224010] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224274] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60117}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.224988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225069] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225525] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60123}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50483}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.225979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226108] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:484}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226565] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846982}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226787] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846984}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.226980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227109] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227174] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227687] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227879] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.227943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60454}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228012] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228664] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:154}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228854] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.228986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846989}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229662] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.229984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230176] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:1152921504606846992}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:125}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230438] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101009}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:108}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:200003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.230965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231028] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231410] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231473] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213975613757000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213965605373000, max_merged_snapshot=1) [2025-04-21 14:09:42.231600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=19] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:09:42.234882] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [619991][T1_SSTableGC][T1][YB420B1D7AB6-00063343B79EFD8B-0-0] [lt=2] SSTableGCTask(cost_ts=69665) [2025-04-21 14:09:42.239622] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1719) [2025-04-21 14:09:42.253584] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=60] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=429, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:42.253641] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=52] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215782253539], gts:1745215782253399000, latest_srr:[mts=1745215782253539]}) [2025-04-21 14:09:42.253669] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:42.268907] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=60] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:42.297035] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.302199] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:42.337910] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE27-0-0] [lt=24] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:42.337974] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE27-0-0] [lt=60] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:42.338563] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=61] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4131, offset=95877}, end_cursor:ObLogCursor{file_id=3, log_id=4132, offset=96183}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7785c050, len:2427, log_data_len:306, seq:4131, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:42.338953] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8A-0-0] [lt=41] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:42.339027] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8A-0-0] [lt=48] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215781777232004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215781777232004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:42.344924] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=69] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4132, offset=96183}, end_cursor:ObLogCursor{file_id=3, log_id=4133, offset=96480}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77860050, len:2121, log_data_len:297, seq:4132, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:42.345186] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8A-0-0] [lt=43] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:42.345246] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8A-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215781777232004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215781777232004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:42.354712] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=154] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3526) [2025-04-21 14:09:42.395005] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:172) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=31] REACH SYSLOG RATE LIMIT [frequency] [2025-04-21 14:09:42.395073] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=65] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:42.395104] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.397124] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=90][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.411396] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=20] ====== check clog disk timer task ====== [2025-04-21 14:09:42.411441] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=39] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:42.422191] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=39] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:42.422272] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:42.422452] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:42.422635] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:42.422732] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8169, [delay/us]:prepare:16, schedule:40, submit:8, rt:1206, total:1272) [2025-04-21 14:09:42.422810] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:42.422879] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=62] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8171, [delay/us]: prepare:16, schedule:40, submit:8, device:1206, total:1272) [2025-04-21 14:09:42.422934] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:42.423008] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1062, total:1095) [2025-04-21 14:09:42.423086] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:42.423123] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1062, total:1095) [2025-04-21 14:09:42.423185] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:42.423212] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:42.424484] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=55] gc stale ls task succ [2025-04-21 14:09:42.440475] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=49] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:42.442402] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:42.442458] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:42.442477] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:42.442506] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:42.442534] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254986992636, flush_io_finished_ret_:0, flush_io_finished_round_:174, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:42.450310] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=44] ====== tenant freeze timer task ====== [2025-04-21 14:09:42.468362] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F4-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.469413] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:42.470901] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F4-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254988021208, cache_obj->added_lc()=false, cache_obj->get_object_id()=762, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:42.475708] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.475708] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=46] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.475769] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.475815] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.476133] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:42.476190] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.497196] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=61][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.502356] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=66] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:42.540434] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1766) [2025-04-21 14:09:42.540571] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1766, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:42.545272] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [619993][T1_MediumLoop][T1][YB420B1D7AB6-00063343B57EFD8F-0-0] [lt=67] MediumCheckTask(cost_ts=19) [2025-04-21 14:09:42.574045] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:42.574219] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=162] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:42.583443] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=72] gc stale ls task succ [2025-04-21 14:09:42.593914] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=69] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:42.594302] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=322] temporary file module use no blocks [2025-04-21 14:09:42.594416] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=108] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:42.594514] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=90] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:42.594600] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=83] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254987144085, flush_io_finished_ret_:0, flush_io_finished_round_:174, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:42.597276] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.599062] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=2, size_used=0, mem_used=8318976) [2025-04-21 14:09:42.599227] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=146] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.602857] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=30] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:42.602936] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=57] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=35) [2025-04-21 14:09:42.604017] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:42.607970] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:42.608014] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:42.609732] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:42.609769] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:42.638486] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:42.638552] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:42.641533] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:42.641596] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=49] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:42.642153] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=538] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:42.657450] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=20] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:42.657512] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=60] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=2) [2025-04-21 14:09:42.657532] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=19] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:42.657550] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620127][T1001_SSTableDe][T1001][Y0-0000000000000000-0-0] [lt=14] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:42.667296] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26521387}, readable_log_tail:{lsn:26521387}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40583381, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:42.667444] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=146] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:42.667488] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=21] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:42.669940] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:42.690080] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=38] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585000468480, fast_delete_log_mode=false) [2025-04-21 14:09:42.694860] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.694989] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=29] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695344] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695491] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695530] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695614] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=41] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695668] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695718] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695763] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.695997] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.696411] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:42.697339] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=86][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.700360] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215772697737, end_time=1745215782700356, dag_status={}) [2025-04-21 14:09:42.700411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=48] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700448] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700475] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700494] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700513] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700532] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700554] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:42.700588] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700608] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700623] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700637] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700658] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700679] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700699] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700719] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700739] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700759] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700778] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700807] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700828] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700847] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700867] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700886] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700905] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700924] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700944] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700963] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700982] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.700997] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701049] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701069] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701088] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701107] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701127] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701146] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701165] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701185] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701204] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701223] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701242] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701269] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701289] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701354] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701375] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701391] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=15] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701433] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701447] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701466] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701486] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701532] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701552] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701571] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701591] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701610] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701629] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701648] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701684] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701698] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701717] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701737] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701756] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701776] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701795] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701814] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701834] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701853] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701873] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701892] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701911] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701931] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:42.701972] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:42.701992] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:42.702012] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:42.702029] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:42.702046] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:42.702063] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:42.702080] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:42.702099] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:42.702117] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:42.702134] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:42.702153] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:42.702175] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:09:42.702197] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:09:42.702539] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=88] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:42.707654] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=25][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:42.707825] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=48][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:42.709066] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=62] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7773) [2025-04-21 14:09:42.712503] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=17] Garbage Collector is running(seq_=18, gc_interval=10000000) [2025-04-21 14:09:42.712575] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:42.712610] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=26] gc_check_member_list_ cost time(ret=0, time_us=66) [2025-04-21 14:09:42.712641] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=23] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:42.713983] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:42.714031] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=41] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:42.714051] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=22) [2025-04-21 14:09:42.714068] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyHandler start process [2025-04-21 14:09:42.714082] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:42.714116] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:42.738550] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:42.738648] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=76] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:42.738699] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:42.738745] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:42.738798] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1841, avg_group_log_size=184) [2025-04-21 14:09:42.738833] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1841) [2025-04-21 14:09:42.740060] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1498, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:42.740128] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:42.740205] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:42.740235] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1598, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:42.740271] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:42.748749] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=45] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:42.750726] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE13-0-0] [lt=76] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:42.750857] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE15-0-0] [lt=42] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:42.769129] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:42.772616] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F040D-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.772731] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE2E-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.774806] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0410-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.775181] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0411-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.776142] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0412-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.777483] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0414-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.781127] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE11-0-0] [lt=58] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:42.796061] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:42.797483] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=69] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:42.797530] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:42.797561] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.809505] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=38][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:42.812673] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:42.812736] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:42.814526] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3526) [2025-04-21 14:09:42.814607] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3526) [2025-04-21 14:09:42.814657] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=30, avg_log_submit_to_flush_time=1500, avg_log_submit_to_slide_time=1520) [2025-04-21 14:09:42.814742] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3526, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:42.828858] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=46] gc stale ls task succ [2025-04-21 14:09:42.829076] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16735, max_lsn:26522565, max_scn:{val:1745215782768054000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26522565}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26521976}, last_submit_end_lsn:{lsn:26522565}, last_submit_log_id:16735, last_submit_log_pid:3, max_flushed_lsn:{lsn:26521976}, max_flushed_end_lsn:{lsn:26522565}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26522565}, last_slide_log_id:16735, last_slide_scn:{val:1745215782768054000, v:0}, last_slide_lsn:{lsn:26521976}, last_slide_end_lsn:{lsn:26522565}, last_slide_log_pid:3, last_slide_log_accum_checksum:3567157663, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16736, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26522565}, readable_log_tail:{lsn:26522565}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40582203, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:42.829335] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=251] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215782770484, last_flushed_end_lsn:{lsn:26522565}}]) [2025-04-21 14:09:42.829370] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=31] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16736, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215782770484, last_flushed_end_lsn:{lsn:26522565}}]) [2025-04-21 14:09:42.840359] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:42.841207] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:42.841260] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=43] temporary file module use no blocks [2025-04-21 14:09:42.841277] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:42.841304] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:42.841327] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254987391430, flush_io_finished_ret_:0, flush_io_finished_round_:174, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:42.844395] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=22] skip repeat study(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215722841913, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215782844391, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:42.846015] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=60] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662834371000, snapshot_type=1, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:42.846060] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662469863000, snapshot_type=2, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:42.846077] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=16] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=1745215662670149000, snapshot_type=3, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:42.846097] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=18] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215662835117, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:42.846311] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=12] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215722841913, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215662469863000, v:0}, reserved_snapshot={val:1745215662469863000, v:0}) [2025-04-21 14:09:42.846349] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=37] multi-version garbage collector refresh successfully(this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215722841913, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215662469863000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215662835117, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:09:42.846380] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=28] repeat refresh successfully(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215782846378, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215782844455, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:09:42.846404] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [619999][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] skip repeat reclaim(ret=0, this={this:0x7f3c6bf74f30, last_study_timestamp:1745215662845332, last_refresh_timestamp:1745215782846378, last_reclaim_timestamp:1745215662851940, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215662469863000, v:0}, is_inited:true}, current_timestamp=1745215782846403, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:42.862076] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=86] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:42.870457] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:42.895193] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:42.895262] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.897480] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=20][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:42.902677] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:42.909020] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00B2-0-0] [lt=42] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:42.910035] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF6-0-0] [lt=44] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:42.915366] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=42] start to print blacklist info [2025-04-21 14:09:42.915540] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=37] ls blacklist refresh finish(cost_time=8443) [2025-04-21 14:09:42.928702] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=57] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:42.929137] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=54] LogLoopThread round_cost_time(us)(round_cost_time=381) [2025-04-21 14:09:42.955209] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDC9-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.955209] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3526, avg_group_log_size=352) [2025-04-21 14:09:42.956459] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1382, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:42.956513] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:42.956576] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:42.956601] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1519, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:42.956630] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:42.956974] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0417-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:42.965861] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=54] current monitor number(seq_=-1) [2025-04-21 14:09:42.966403] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=52] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:42.971007] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1412, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:42.971070] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:42.971140] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:42.971176] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1543, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:42.971190] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1499, avg_log_submit_to_slide_time=1519) [2025-04-21 14:09:42.971239] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:42.973074] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE17-0-0] [lt=17] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:42.976320] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:42.976386] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:42.989221] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=109] BlockGCTimerTask success(ret=0, cost_time_us=114, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:42.997547] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.014729] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1, new_min_version={val:1745215782811984000, v:0}, new_max_version={val:1745215782811984000, v:0}, last_min_version={val:1745215782611791000, v:0}, last_max_version={val:1745215782611791000, v:0}, total_time_us=3640, delta_us=202741) [2025-04-21 14:09:43.014798] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=65] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1, current_version={val:1745215782811984000, v:0}, min_version={val:1745215782811984000, v:0}, max_version={val:1745215782811984000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:43.015419] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=58] PNIO [ratelimit] time: 1745215783015415, bytes: 5361545, bw: 0.012088 MB/s, add_ts: 1007613, add_bytes: 12772 [2025-04-21 14:09:43.034042] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F041A-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.034639] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F041B-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.037864] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:43.037904] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=40] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:43.037898] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC7-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:43.037945] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC7-0-0] [lt=43] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:43.040315] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:43.040387] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=88] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1548, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:43.040441] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:43.040444] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1577, avg_log_submit_to_slide_time=1599) [2025-04-21 14:09:43.040495] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:43.040526] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:43.040544] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1696, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:43.040558] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=35, avg_log_submit_to_flush_time=1648, avg_log_submit_to_slide_time=1660) [2025-04-21 14:09:43.040583] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:43.040612] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:43.043250] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:43.061999] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:43.062115] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=73] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:43.062153] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=35] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=289, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:43.062229] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:43.062299] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=29] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:43.062323] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=23] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=31, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:43.071014] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:43.097629] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.099358] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=51] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:43.099444] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=77] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.099511] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=69] PNIO [ratelimit] time: 1745215783099507, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007846, add_bytes: 0 [2025-04-21 14:09:43.102835] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=54] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:43.109725] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7774, avg_group_log_size=647) [2025-04-21 14:09:43.109776] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:43.111441] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7774) [2025-04-21 14:09:43.111531] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7774) [2025-04-21 14:09:43.111638] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7774, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:43.197715] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.240402] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:43.254571] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:43.263316] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDA-0-0] [lt=37] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:43.263368] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDA-0-0] [lt=44] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=54) [2025-04-21 14:09:43.271535] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:43.297792] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.302978] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:43.339726] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE28-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:43.339776] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE28-0-0] [lt=46] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:43.350621] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4133, offset=96480}, end_cursor:ObLogCursor{file_id=3, log_id=4134, offset=96786}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77864050, len:1824, log_data_len:306, seq:4133, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:43.351066] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8B-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:43.351136] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8B-0-0] [lt=47] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215782754122004, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215782754122004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:43.355506] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3534) [2025-04-21 14:09:43.358948] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=92] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4134, offset=96786}, end_cursor:ObLogCursor{file_id=3, log_id=4135, offset=97083}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77868050, len:1518, log_data_len:297, seq:4134, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:43.359237] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8B-0-0] [lt=39] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:43.359297] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8B-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215782754122004, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215782754122004, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:43.395370] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:43.395422] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.397861] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.414269] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=29] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:43.424262] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:43.424328] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:43.424514] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:43.424564] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=52] gc stale ls task succ [2025-04-21 14:09:43.424700] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:43.424779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:17, schedule:33, submit:8, rt:985, total:1044) [2025-04-21 14:09:43.424853] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:43.424909] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:17, schedule:33, submit:8, device:985, total:1044) [2025-04-21 14:09:43.424969] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:43.425066] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:860, total:882) [2025-04-21 14:09:43.425150] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:43.425187] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:860, total:882) [2025-04-21 14:09:43.425245] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:43.425270] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:43.440660] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=53] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:43.442655] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=42] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:43.442715] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=51] temporary file module use no blocks [2025-04-21 14:09:43.442740] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:43.442766] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:43.442790] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254987992893, flush_io_finished_ret_:0, flush_io_finished_round_:175, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:43.470338] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=16] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:43.471589] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:43.471686] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215781227903000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:43.472246] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:43.475285] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F6-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.475378] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.475803] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.475807] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.475865] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=24] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.476498] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=39] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:43.476550] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.477824] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F6-0-0] [lt=58][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254989028132, cache_obj->added_lc()=false, cache_obj->get_object_id()=763, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:43.497929] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.503113] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:43.525225] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=69] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:43.527550] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26527984}], scn_array=[cnt:1, {val:1745215783508827000, v:0}], curr_size=589, accum_size=4241, time_cost=17681) [2025-04-21 14:09:43.541078] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:43.541156] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:43.552447] INFO [STORAGE.TRANS] run1 (ob_xa_trans_heartbeat_worker.cpp:84) [620299][T1002_ObXAHbWor][T1002][Y0-0000000000000000-0-0] [lt=71] XA scheduler heartbeat task statistics(avg_time=2) [2025-04-21 14:09:43.570274] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:09:43.570407] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA8-0-0] [lt=48] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215783253996001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:43.570581] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA8-0-0] [lt=135] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:43.570657] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA8-0-0] [lt=72] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:43.583513] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=56] gc stale ls task succ [2025-04-21 14:09:43.594850] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=145] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:43.594916] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=57] temporary file module use no blocks [2025-04-21 14:09:43.594934] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:43.594961] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:43.594987] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254988145064, flush_io_finished_ret_:0, flush_io_finished_round_:175, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:43.598024] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.599606] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:43.599682] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=66] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.604205] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=56] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:43.608065] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:43.608110] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:43.609899] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:43.609936] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:43.639401] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:43.639462] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:43.672726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:43.678228] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:43.679265] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:43.679332] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=65] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:43.679412] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:43.679522] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=106] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:43.679558] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:43.679585] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215774245091001, v:0}) [2025-04-21 14:09:43.679605] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:43.679629] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:43.679663] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:43.679686] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:43.679724] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:43.679760] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=35] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:43.680742] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:43.680781] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=39] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:43.680846] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:43.680917] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=69] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:43.680942] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:43.680965] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:43.680988] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:43.681025] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:43.681045] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:43.681067] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:43.681080] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=12] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:43.694659] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695413] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=48] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695437] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695616] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695764] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695788] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.695832] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.696082] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.696502] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.696562] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=30] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.697067] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:43.698095] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.700828] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:43.702097] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:43.702203] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=45] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215775613757000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:43.703239] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:43.709775] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215783709459000, start_id=1745215783709459000, end_id=1745215783709459001) [2025-04-21 14:09:43.709895] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7775) [2025-04-21 14:09:43.731532] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=61] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:43.736819] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDD-0-0] [lt=37] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:43.739452] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:43.739512] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:43.739547] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:43.739570] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:43.739610] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:43.739636] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:43.741047] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1455, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:43.741095] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=96, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:43.741132] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:43.741158] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1623, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:43.741175] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:43.755057] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=63] get number(ret=0, service_type_=0, range=1, base_id=1745215783754395000, start_id=1745215783754395000, end_id=1745215783754395001) [2025-04-21 14:09:43.755306] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215783755293], gts:1745215783754395000, latest_srr:[mts=1745215783755293]}) [2025-04-21 14:09:43.764463] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDAA-0-0] [lt=40] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:43.770157] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:43.775992] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F041D-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.776312] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE2F-0-0] [lt=127][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.778019] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0420-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.778250] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0421-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.778270] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDCA-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.779798] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0423-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.796203] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=58] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:43.798167] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.813561] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:43.813632] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:43.815346] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:43.815428] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:43.815478] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1463, avg_log_submit_to_slide_time=1484) [2025-04-21 14:09:43.815533] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:43.818350] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=29] ====== check clog disk timer task ====== [2025-04-21 14:09:43.818399] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=41] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:43.828943] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:43.834056] INFO [SQL] check_session_leak (ob_sql_session_mgr.cpp:656) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=19] get current session count(used_session_count=24, hold_session_count=24, session_leak_count_threshold=100) [2025-04-21 14:09:43.839473] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:43.839525] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] try gc retain ctx [2025-04-21 14:09:43.839542] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] try to retry start_working [2025-04-21 14:09:43.839602] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] finish update min start scn(max_decided_scn={val:1745215783253996004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215773744068000, v:0}, keep_alive_scn_:{val:1745215778749924000, v:0}, update_ts_:1745215783839208}) [2025-04-21 14:09:43.840540] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=48] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:43.840684] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215790473222000, latest_log_ts:{val:1745215774245091001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:43.840857] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=101] finish update min start scn(max_decided_scn={val:1745215783253996004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215773744068000, v:0}, keep_alive_scn_:{val:1745215778749924000, v:0}, update_ts_:1745215783840271}) [2025-04-21 14:09:43.841471] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=48] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:43.841527] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:43.841546] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:43.841575] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=27] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:43.841594] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254988391693, flush_io_finished_ret_:0, flush_io_finished_round_:175, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:43.841846] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:43.873291] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=67] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:43.882526] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=5600000, clean_num=200000) [2025-04-21 14:09:43.887193] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:43.895519] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:43.895573] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.898238] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:43.903361] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:43.909953] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00B7-0-0] [lt=31] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:43.952215] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=275] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:43.954050] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] get number(ret=0, service_type_=0, range=1, base_id=1745215783953676000, start_id=1745215783953676000, end_id=1745215783953676001) [2025-04-21 14:09:43.955968] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:43.956947] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1364, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:43.957033] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=75] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:43.957090] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:43.957113] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1484, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:43.957136] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:43.958106] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0425-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.959886] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0427-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:43.966012] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=43] current monitor number(seq_=-1) [2025-04-21 14:09:43.971520] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=84] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2980, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:43.971572] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:43.971625] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=33] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:43.971653] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=3103, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:43.971672] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=3063, avg_log_submit_to_slide_time=3081) [2025-04-21 14:09:43.971711] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:43.976656] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:43.976706] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:43.998307] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.023038] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=57] PNIO [ratelimit] time: 1745215784023034, bytes: 5375768, bw: 0.013462 MB/s, add_ts: 1007619, add_bytes: 14223 [2025-04-21 14:09:44.038022] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F042A-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.038616] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F042B-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.040972] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:44.041044] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1409, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:44.041092] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:44.041112] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:44.041146] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1522, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:44.041163] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:44.043386] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:44.068575] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=46] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215783754395000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=314164, in_cluster_service=true, cluster_version={val:1745215783253996004, v:0}, min_cluster_version={val:1745215783253996004, v:0}, max_cluster_version={val:1745215783253996004, v:0}, get_cluster_version_err=0, cluster_version_delta=814563, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1594, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=114944295, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:44.083077] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:44.098327] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.099865] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:44.099960] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=85] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.103499] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:44.106884] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=37] PNIO [ratelimit] time: 1745215784106878, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007371, add_bytes: 0 [2025-04-21 14:09:44.107068] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:44.107119] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=45] start lib cache evict(tenant_id=1001, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:44.107141] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:44.107164] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:44.110450] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8321, avg_group_log_size=640) [2025-04-21 14:09:44.110500] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:44.110345] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=35] Dumping All Cache Objs(alloc_obj_list.count()=156, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}, {obj_id:457, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:44.110712] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=362] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:44.112059] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] get_max_applied_scn(scn={val:1745215784013417000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:65980016}, palf_committed_end_scn_:{val:1745215784013417000, v:0}, last_check_scn_:{val:1745215784013417000, v:0}, max_applied_cb_scn_:{val:1745215784013417000, v:0}}) [2025-04-21 14:09:44.112115] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:65980016}, readable_log_tail:{lsn:65980016}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1124752, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:44.112284] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8321) [2025-04-21 14:09:44.112370] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8321) [2025-04-21 14:09:44.112472] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=63] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8321, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:44.112574] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215783909883000, v:0}, new_max_version={val:1745215783909883000, v:0}, last_min_version={val:1745215783709459000, v:0}, last_max_version={val:1745215783709459000, v:0}, total_time_us=3941, delta_us=202688) [2025-04-21 14:09:44.112611] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215783909883000, v:0}, min_version={val:1745215783909883000, v:0}, max_version={val:1745215783909883000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:44.141471] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:09:44.141540] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1497, avg_log_submit_to_slide_time=1516) [2025-04-21 14:09:44.141633] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1497, avg_log_submit_to_slide_time=1513) [2025-04-21 14:09:44.141672] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:44.188093] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=102] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:44.198397] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.241092] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:44.255545] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=32] ts response task statistics(alloc_count=3966, free_count=1982) [2025-04-21 14:09:44.255598] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:44.255823] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=23] submit log success(service_type_=0, last_id=1745215800473222000, limited_id=1745215800473222000) [2025-04-21 14:09:44.255843] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=19] submit log with lock success(service_type_=0, last_id=1745215800473222000, limited_id=1745215800473222000) [2025-04-21 14:09:44.255867] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=12] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=425, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:44.257119] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=23] update id meta(ret=0, service_type=0, limited_id=1745215800473222000, latest_scn={val:1745215784255499001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215781228971000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:44.257257] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=136] handle submit callback(service_type_=0, success=true, used_ts=1434, log_ts={val:1745215784255499001, v:0}, limited_id=1745215800473222000) [2025-04-21 14:09:44.257281] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=22] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:44.257306] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=23] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:44.283606] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=90] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:44.298479] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.308505] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8400000, replace_num=100000) [2025-04-21 14:09:44.308551] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:44.309058] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=53] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:44.312441] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] get_max_applied_scn(scn={val:1745215784169975000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26533831}, palf_committed_end_scn_:{val:1745215784309881000, v:0}, last_check_scn_:{val:1745215784309881000, v:0}, max_applied_cb_scn_:{val:1745215784169975000, v:0}}) [2025-04-21 14:09:44.312495] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=48] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26533831}, readable_log_tail:{lsn:26533831}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40570937, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:44.341257] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE29-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:44.341302] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE29-0-0] [lt=42] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:44.356242] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3535) [2025-04-21 14:09:44.365778] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=37] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4135, offset=97083}, end_cursor:ObLogCursor{file_id=3, log_id=4136, offset=97389}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7786c050, len:1221, log_data_len:306, seq:4135, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:44.366114] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=33] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:44.366173] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=42] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215784255499001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215784255499001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:44.369045] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=13] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=499873996, MAX_GAP=900000000000, new_sync_scn={val:1745215783253996000, v:0}, new_replayable_scn={val:1745215783253996000, v:0}, new_readable_scn={val:1745215782754122004, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215782253399000, replayable_scn:1745215782253399000, readable_scn:1745215781777232004, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:44.369347] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1745215784368629000, start_id=1745215784368629000, end_id=1745215784368629001) [2025-04-21 14:09:44.370811] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=40] [APPLY STAT CB APPEND COST TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=56, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:44.370854] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=42] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=2061, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:44.370870] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:44.370884] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=-523, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:44.370897] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=53, stat_interval=5000000, avg (count/cost)=1594, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:44.371701] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=99] get_max_applied_scn(scn={val:1745215784255499001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17419799}, palf_committed_end_scn_:{val:1745215784255499001, v:0}, last_check_scn_:{val:1745215784255499001, v:0}, max_applied_cb_scn_:{val:1745215784255499001, v:0}}) [2025-04-21 14:09:44.371750] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17419799}, readable_log_tail:{lsn:17419799}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49684969, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:44.372110] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=79] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4136, offset=97389}, end_cursor:ObLogCursor{file_id=3, log_id=4137, offset=97686}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77870050, len:915, log_data_len:297, seq:4136, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:44.372405] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=34] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:44.372455] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8C-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215784255499000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215784255499000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:44.391140] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=69] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:44.395658] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:44.395703] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.396495] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620177][T1001_Compactio][T1001][YB420B1D7AB6-00063343B7CEFD8B-0-0] [lt=59] InfoPoolResizeTask(cost_ts=8) [2025-04-21 14:09:44.398557] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.401869] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:44.401918] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:44.401944] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=22] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=36) [2025-04-21 14:09:44.403848] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=24] ====== traversal_flush timer task ====== [2025-04-21 14:09:44.403948] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA9-0-0] [lt=31] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215784309881000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:44.404062] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDA9-0-0] [lt=107] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:44.411564] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:44.411637] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=64] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:44.424632] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=69] gc stale ls task succ [2025-04-21 14:09:44.426308] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:44.426374] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=41] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:44.426561] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:44.426761] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:44.426853] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:14, schedule:31, submit:7, rt:1081, total:1134) [2025-04-21 14:09:44.426934] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:44.427002] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:14, schedule:31, submit:7, device:1081, total:1134) [2025-04-21 14:09:44.427064] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:44.427141] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:654, total:668) [2025-04-21 14:09:44.427223] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:44.427261] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:654, total:668) [2025-04-21 14:09:44.427323] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:44.427351] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:44.440802] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:44.442918] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:44.442977] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=50] temporary file module use no blocks [2025-04-21 14:09:44.443003] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:44.443034] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:44.443061] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254988993153, flush_io_finished_ret_:0, flush_io_finished_round_:176, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:44.448804] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=57][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:44.448909] WDIAG read_multi_row (ob_table_access_helper.h:238) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:44.450499] INFO delete_row (ob_table_access_helper.h:312) [620151][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215784448940) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215784448940) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:44.451934] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=42] ====== tenant freeze timer task ====== [2025-04-21 14:09:44.453044] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] ====== checkpoint timer task ====== [2025-04-21 14:09:44.454057] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=44] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:44.454121] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=63] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:44.454203] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=41] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:44.454318] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=106] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:44.454367] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=39] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:44.454395] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] get rec log scn(service_type_=0, rec_log_ts={val:1745215781308321001, v:0}) [2025-04-21 14:09:44.454416] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:44.454436] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=16] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:44.454460] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:44.454493] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:44.454518] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:44.454553] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=23][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:44.454587] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:44.454609] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:44.468995] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=90] get_max_applied_scn(scn={val:1745215784255499000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9193455}, palf_committed_end_scn_:{val:1745215784255499001, v:0}, last_check_scn_:{val:1745215784255499001, v:0}, max_applied_cb_scn_:{val:1745215784255499000, v:0}}) [2025-04-21 14:09:44.469056] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=57] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9193455}, readable_log_tail:{lsn:9193455}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57911313, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:44.475328] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=50] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.475628] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.475684] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.475896] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.476818] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:44.476870] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.482337] WDIAG begin (ob_hashtable.h:954) [620064][T1_L0_G0][T1][YB420B1D7AB6-00063343B71EFD8B-0-0] [lt=54][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.484110] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:44.484722] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620064][T1_L0_G0][T1][YB420B1D7AB6-00063343B71EFD8B-0-0] [lt=35][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254990034994, cache_obj->added_lc()=false, cache_obj->get_object_id()=764, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:44.498626] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.508661] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=18] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:44.541534] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1217, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:44.557781] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=46] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:44.574363] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:09:44.574442] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=66] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:44.583594] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:44.598705] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.600124] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=29] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:44.600199] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=67] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.604369] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:44.607916] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:44.607956] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:44.609621] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:44.609658] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:44.615608] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=101] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:44.640200] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=86] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:44.640250] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:44.641630] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1339) [2025-04-21 14:09:44.643021] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] ====== tenant freeze timer task ====== [2025-04-21 14:09:44.643067] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:44.643107] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:44.655672] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:44.655722] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=39] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=34) [2025-04-21 14:09:44.656531] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:44.656580] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=37] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:44.656606] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=23] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:44.656624] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=17] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=34) [2025-04-21 14:09:44.665015] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=101] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:44.665053] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=37] try gc retain ctx [2025-04-21 14:09:44.665067] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=13] try to retry start_working [2025-04-21 14:09:44.665107] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215784569395000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215774561381001, v:0}, keep_alive_scn_:{val:1745215779565380001, v:0}, update_ts_:1745215784664955}) [2025-04-21 14:09:44.666110] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:44.671821] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=57] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:44.684598] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:44.691044] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=32] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:44.691131] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=68] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=36) [2025-04-21 14:09:44.694541] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=34] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:44.694614] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=55] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:44.694656] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=36] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=36) [2025-04-21 14:09:44.695017] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695091] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695256] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=49] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695267] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695431] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695459] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695599] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=56] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695721] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.695730] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=70] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.696071] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.696629] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=28] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:44.698795] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.708798] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:44.710977] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=92] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8432) [2025-04-21 14:09:44.740265] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:44.740318] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1217, avg_group_log_size=121) [2025-04-21 14:09:44.740344] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:44.740369] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:44.740406] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:44.740428] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:44.742156] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1317, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:44.742198] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=141, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:44.742227] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=27] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=70, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:44.742230] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:44.742308] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=80] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1614, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:44.742315] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=84] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1529, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:44.742325] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:44.742345] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-556, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:44.742344] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:44.742361] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=15] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1128, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:44.749329] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F9-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.751791] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01F9-0-0] [lt=37][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254990302097, cache_obj->added_lc()=false, cache_obj->get_object_id()=765, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:44.753187] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01FD-0-0] [lt=42][errcode=-4201] hashtable not init [2025-04-21 14:09:44.753223] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01FD-0-0] [lt=35] get cursor info failed(cursor_id=52, get_sessid()=3221487630) [2025-04-21 14:09:44.753367] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=17] get number(ret=0, service_type_=0, range=1, base_id=1745215784752949000, start_id=1745215784752949000, end_id=1745215784752949001) [2025-04-21 14:09:44.756120] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=18] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=402, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:44.756167] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=43] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215784756108], gts:1745215784755111000, latest_srr:[mts=1745215784756108]}) [2025-04-21 14:09:44.770896] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=96] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:44.779489] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F042D-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.779489] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE30-0-0] [lt=50][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.780470] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F042E-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.781468] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0431-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.781452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000) [2025-04-21 14:09:44.781501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=48] get multi version start(ls_id={id:1}, tablet_id={id:60476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.781519] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE32-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.781593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.781686] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.781763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.781857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.781935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782011] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782424] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782500] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782602] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0432-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.782642] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=50] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782824] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.782965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783552] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.783963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784170] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784407] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784696] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.784984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:101062}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785227] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785578] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785779] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.785989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786281] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786494] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786573] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786643] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.786935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:60444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787862] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.787996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788142] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788217] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.788991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789080] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:60459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789163] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789370] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789641] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.789982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790052] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790344] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790836] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.790972] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791041] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791124] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791345] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791412] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791619] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791757] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.791961] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792331] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792747] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.792962] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.793958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794245] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794320] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:50392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794389] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.794950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795035] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795104] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795240] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101094}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795721] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795875] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.795950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796106] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796248] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796386] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:44.796475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796891] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.796975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797126] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797909] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.797981] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798040] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798728] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798797] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:279}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.798864] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.798953] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799430] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799567] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.799936] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50226}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800074] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800282] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800486] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800554] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800620] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800930] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.800998] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=38] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50485}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801426] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801493] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801762] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.801997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802693] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.802992] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.803965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50451}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804100] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804377] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804659] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.804950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60401}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805249] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.805955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50349}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806583] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.806954] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807094] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807504] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.807999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808205] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808273] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808409] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.808988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809214] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809283] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101089}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809557] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809915] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60455}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.809982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810188] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50472}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810529] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810689] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50432}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810761] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60392}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.810979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50296}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811047] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811182] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811386] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811455] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811811] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:507}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.811950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812086] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812363] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812585] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812793] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812862] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.812937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813166] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813233] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813435] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813589] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.813932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814002] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814294] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814362] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814391] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:44.814434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814456] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:44.814523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814890] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.814959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815095] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815164] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815298] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50517}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815860] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.815995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60357}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816419] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816510] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816654] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816722] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.816933] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817445] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817864] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.817999] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818067] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818492] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.818983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819189] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819404] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819617] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819684] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819752] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819888] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.819955] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820229] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820300] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820590] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820657] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820725] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820794] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820862] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.820932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821161] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821229] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821378] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:430}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.821993] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822060] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60475}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822759] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=43] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.822943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50371}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823130] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823192] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823328] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823638] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823697] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.823996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824057] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=18] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824495] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50404}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.824996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:119}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825139] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50412}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825475] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60385}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825826] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.825974] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826117] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826183] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826347] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60374}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826556] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826906] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.826977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827119] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:44.827184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=32] get multi version start(ls_id={id:1}, tablet_id={id:60500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60389}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827402] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60249}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.827952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828019] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828237] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828313] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=37] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:44.828371] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828422] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215778810123000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:44.828466] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828536] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.828965] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:44.829025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:360}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829401] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829699] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829767] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50462}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829901] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.829968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830034] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:342}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830386] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.830934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831075] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:358}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831365] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831496] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:457}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831561] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831627] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831691] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831755] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:458}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.831950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832305] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832373] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832441] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832511] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832717] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832912] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60362}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.832977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833682] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833748] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:386}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833877] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60511}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.833942] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50383}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834007] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=29] get multi version start(ls_id={id:1}, tablet_id={id:60400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834222] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:399}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834416] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834484] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.834973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50372}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835348] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835414] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50354}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50456}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.835941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836024] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836158] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836639] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836710] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.836997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837084] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:160}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837152] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837218] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837424] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837490] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837559] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837625] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50370}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837690] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837820] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.837968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=26] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838110] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838175] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838304] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838632] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60403}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.838921] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839003] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839204] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60315}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839400] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50473}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:461}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:50158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839878] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.839959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50477}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840296] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840436] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840502] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840636] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:416}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840704] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:44.840772] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840838] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840917] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50363}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.840988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841077] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=36] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841149] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:452}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60446}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841613] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841745] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841812] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.841959] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842091] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60376}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842157] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842223] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:479}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842357] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842517] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842800] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842894] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.842979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60409}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843469] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50390}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843599] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843806] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843885] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.843952] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:459}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844083] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844150] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844216] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844281] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:265}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844346] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844477] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50361}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844543] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844609] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844823] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60359}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.844958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845116] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:158}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845251] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845317] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845386] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60508}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845452] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60348}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845518] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:322}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845649] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:345}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845715] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845801] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845868] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.845937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50344}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846004] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60317}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:393}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846212] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846311] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=19][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65982696}], scn_array=[cnt:1, {val:1745215784814079000, v:0}], curr_size=585, accum_size=3972, time_cost=31791) [2025-04-21 14:09:44.846364] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3972) [2025-04-21 14:09:44.846383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846432] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3972) [2025-04-21 14:09:44.846461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846484] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=4421, avg_log_submit_to_slide_time=4442) [2025-04-21 14:09:44.846532] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846542] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3972, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:44.846604] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50478}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60411}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60460}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.846943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847085] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50476}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:444}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847286] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847427] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847496] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.847982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848118] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50486}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848318] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848383] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848449] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848514] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848580] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60516}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213978810123000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213968801390000, max_merged_snapshot=1) [2025-04-21 14:09:44.848680] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:116) [620176][T1001_SSTableGC][T1001][YB420B1D7AB6-00063343B7DEFD8B-0-0] [lt=25] SSTableGCTask(cost_ts=67639) [2025-04-21 14:09:44.870696] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=135] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:44.885103] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:44.895780] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:44.895833] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.898931] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:44.908936] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:44.910544] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00BC-0-0] [lt=39] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:44.920728] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=44] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:44.921252] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=77] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:44.926628] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=46] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:44.927636] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26538772}], scn_array=[cnt:1, {val:1745215784910456000, v:0}], curr_size=589, accum_size=6708, time_cost=16782) [2025-04-21 14:09:44.945493] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=22] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:44.945538] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=42] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:44.945557] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=17] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:44.945580] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:44.945754] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=137] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:44.948839] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=21] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:44.949577] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=735] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:44.956665] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3972, avg_group_log_size=397) [2025-04-21 14:09:44.957944] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4352, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:44.957999] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:44.958050] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:44.958077] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4490, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:44.958097] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:44.960970] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0434-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.962576] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0436-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:44.966156] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:09:44.972190] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2562, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:44.972241] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:44.972289] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:44.972313] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2719, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:44.972333] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=30, avg_log_gen_to_submit_time=44, avg_log_submit_to_flush_time=2656, avg_log_submit_to_slide_time=2675) [2025-04-21 14:09:44.972369] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:44.976973] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:44.977040] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:44.999005] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.008788] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620178][T1001_MediumLoo][T1001][YB420B1D7AB6-00063343B66EFD8F-0-0] [lt=46] MediumCheckTask(cost_ts=14) [2025-04-21 14:09:45.014231] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215785013386000, start_id=1745215785013386000, end_id=1745215785013386001) [2025-04-21 14:09:45.030651] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=54] PNIO [ratelimit] time: 1745215785030647, bytes: 5388540, bw: 0.012088 MB/s, add_ts: 1007613, add_bytes: 12772 [2025-04-21 14:09:45.038478] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:45.038508] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC8-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:45.038520] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=41] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:45.038548] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC8-0-0] [lt=36] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:45.041998] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0439-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.042055] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:45.042147] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1917, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:45.042207] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:45.042256] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:45.042297] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2038, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:45.042329] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:45.042649] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F043A-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.043524] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:45.085577] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=41] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:45.099074] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.100347] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:45.100414] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.106950] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=18) [2025-04-21 14:09:45.109049] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:45.111259] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7883, avg_group_log_size=606) [2025-04-21 14:09:45.111306] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:45.112806] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7883) [2025-04-21 14:09:45.112877] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7883) [2025-04-21 14:09:45.112955] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7883, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:45.113075] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215784910456000, v:0}, new_max_version={val:1745215784910456000, v:0}, last_min_version={val:1745215784710190000, v:0}, last_max_version={val:1745215784710190000, v:0}, total_time_us=3527, delta_us=202617) [2025-04-21 14:09:45.113111] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215784910456000, v:0}, min_version={val:1745215784910456000, v:0}, max_version={val:1745215784910456000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:45.114490] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=51] PNIO [ratelimit] time: 1745215785114486, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2025-04-21 14:09:45.142191] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=11, avg_log_submit_to_flush_time=2029, avg_log_submit_to_slide_time=2050) [2025-04-21 14:09:45.142258] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1226) [2025-04-21 14:09:45.142283] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=2001, avg_log_submit_to_slide_time=2013) [2025-04-21 14:09:45.142271] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=74] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:45.142227] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=34, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:45.142326] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=97] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1560, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:45.142343] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=17] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:45.142358] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=-442, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:45.142372] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0402-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=25, stat_interval=5000000, avg (count/cost)=1151, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:45.199113] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.242110] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:45.256587] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=23] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215785256558], gts:1745215785256380000, latest_srr:[mts=1745215785256558]}) [2025-04-21 14:09:45.256638] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=50] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:45.263871] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDB-0-0] [lt=42] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:45.263913] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDB-0-0] [lt=36] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=45) [2025-04-21 14:09:45.265336] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=67] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:45.286101] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:45.299182] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.309173] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:45.309676] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215785111076000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198591, in_cluster_service=true, cluster_version={val:1745215784910456000, v:0}, min_cluster_version={val:1745215784910456000, v:0}, max_cluster_version={val:1745215784910456000, v:0}, get_cluster_version_err=0, cluster_version_delta=399211, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1606, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=120130260, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:45.311507] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=54][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:45.343182] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2A-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:45.343238] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2A-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:45.356974] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3971) [2025-04-21 14:09:45.371070] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=45] get number(ret=0, service_type_=0, range=1, base_id=1745215785370625000, start_id=1745215785370625000, end_id=1745215785370625001) [2025-04-21 14:09:45.377231] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] success to update min reserved snapshot(reserved_snapshot=1745213975613757000, duration=1800, snapshot_gc_ts=1745215775613757000) [2025-04-21 14:09:45.377346] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] success to update min reserved snapshot(reserved_snapshot=1745213978810123000, duration=1800, snapshot_gc_ts=1745215778810123000) [2025-04-21 14:09:45.377664] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=42] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4137, offset=97686}, end_cursor:ObLogCursor{file_id=3, log_id=4138, offset=97992}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77874050, len:618, log_data_len:306, seq:4137, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:45.377934] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8D-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:45.377994] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8D-0-0] [lt=44] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215785256380000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215785256380000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:45.378695] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=51] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213975613757000) [2025-04-21 14:09:45.378732] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] update reserved snapshot finished(cost_ts=1507, reserved_snapshot=1745213975613757000) [2025-04-21 14:09:45.378780] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] update reserved snapshot finished(cost_ts=1437, reserved_snapshot=1745213978810123000) [2025-04-21 14:09:45.383731] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=51] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4138, offset=97992}, end_cursor:ObLogCursor{file_id=3, log_id=4139, offset=98289}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77878050, len:4408, log_data_len:297, seq:4138, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:45.383954] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8D-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:45.384006] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8D-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215785256380000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215785256380000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:45.395935] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:45.395981] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.399248] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.410299] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=44] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:45.411495] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDAA-0-0] [lt=37] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:45.411816] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=43] get number(ret=0, service_type_=0, range=1, base_id=1745215785411231000, start_id=1745215785411231000, end_id=1745215785411231001) [2025-04-21 14:09:45.413054] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=65989024, this={dio_aligned_buf:{buf_write_offset:3009, buf_padding_size:1087, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4452, truncate_used_ts:1859}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=4096, aligned_block_offset=65986560, buf_len=545, total_write_size=39290, total_write_size_after_dio=471040, ob_pwrite_used_ts=180586, count=106, each_pwrite_cost=1703) [2025-04-21 14:09:45.424703] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:45.428371] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:45.428430] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:45.428603] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:45.428789] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:45.428879] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12263, [delay/us]:prepare:14, schedule:23, submit:6, rt:1134, total:1178) [2025-04-21 14:09:45.428956] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:45.429040] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=75] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12263, [delay/us]: prepare:14, schedule:23, submit:6, device:1134, total:1178) [2025-04-21 14:09:45.429108] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:45.429181] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:655, total:669) [2025-04-21 14:09:45.429258] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:45.429296] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:655, total:669) [2025-04-21 14:09:45.429357] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:45.429380] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:45.429486] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=19] skip repeat study(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215725425150, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215785429482, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:45.430854] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=53] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665417380000, snapshot_type=1, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:45.430899] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665179407000, snapshot_type=2, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:45.430917] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=17] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=1745215665378928001, snapshot_type=3, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:45.430932] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=13] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1001 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215665418079, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:45.431084] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=17] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215725425150, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215665179407000, v:0}, reserved_snapshot={val:1745215665179407000, v:0}) [2025-04-21 14:09:45.431116] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=30] multi-version garbage collector refresh successfully(this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215725425150, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215665179407000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215665418079, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:09:45.431146] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=29] repeat refresh successfully(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215785431145, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215785429539, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:09:45.431168] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [620184][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=20] skip repeat reclaim(ret=0, this={this:0x7f3c4cfc0f30, last_study_timestamp:1745215665430442, last_refresh_timestamp:1745215785431145, last_reclaim_timestamp:1745215665439716, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215665179407000, v:0}, is_inited:true}, current_timestamp=1745215785431167, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:45.440938] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:45.474997] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.475463] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.475519] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.475986] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.477141] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:45.477192] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.486635] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:45.488255] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01FF-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.491219] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF01FF-0-0] [lt=55][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254991041525, cache_obj->added_lc()=false, cache_obj->get_object_id()=766, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:45.499318] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.509316] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:45.533478] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=107] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:45.542420] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:45.572821] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=54] get wrs ts(ls_id={id:1}, delta=316117, log_service_ts=1745215785256380, min_tx_service_ts=4611686018427387, timestamp={val:1745215785256380001, v:0}) [2025-04-21 14:09:45.572870] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=44] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1002, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=6, Other_Error_Cnt=0, Submit_Succ_Cnt=94, last_scn="{val:1745215783754395000, v:0}", last_lsn={lsn:17419126}, last_gts={val:1745215785256380000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:45.583664] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:45.595202] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:45.595252] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:45.595269] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:45.595289] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:45.595307] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=17] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254990145442, flush_io_finished_ret_:0, flush_io_finished_round_:177, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:45.599389] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.600528] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:45.600573] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.604533] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:45.608023] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:45.608064] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:45.608259] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:45.608363] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620268][T1002_DupTbLeas][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1002 and flag like "%DUPLICATE%", tenant_id=1002, exec_tenant_id=1001, need_member_list=false) [2025-04-21 14:09:45.609678] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:45.609715] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:45.640962] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:45.641033] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:45.642201] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:45.687161] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:45.695076] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=33] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.695214] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.695508] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.695806] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.695806] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696021] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696042] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696100] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696107] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696219] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.696359] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:45.699461] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.709456] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:45.710378] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=32] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17421385}, readable_log_tail:{lsn:17421385}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49683383, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:45.710497] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=117] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:45.710525] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=24] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9194919}, readable_log_tail:{lsn:9194919}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57909849, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:45.710589] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=63] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:45.710629] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:45.711542] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7882) [2025-04-21 14:09:45.741022] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:45.741087] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:45.741117] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:45.741140] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:45.741181] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:45.741217] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:45.741964] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDE-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:45.742244] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1782, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:45.742286] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:45.742372] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:45.742407] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1884, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:45.742437] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:45.749621] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0201-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.751903] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0201-0-0] [lt=34][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254991302212, cache_obj->added_lc()=false, cache_obj->get_object_id()=767, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:45.753054] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE17-0-0] [lt=24] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:45.757041] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] handle gts request statistics(total_rt=371, total_cnt=60, avg_rt=6.081967213114753967e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:45.757658] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=19] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:45.757695] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=33] finish to resize log external storage handler(current_ts=1745215785757691, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:45.761610] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA9-0-0] [lt=17] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:45.761665] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDA9-0-0] [lt=46] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:45.765856] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] Garbage Collector is running(seq_=18, gc_interval=10000000) [2025-04-21 14:09:45.765924] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=38] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:45.765952] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=24] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:45.765978] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] gc_check_member_list_ cost time(ret=0, time_us=83) [2025-04-21 14:09:45.766001] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:45.767328] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:45.768646] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=36] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:45.768690] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:45.768730] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:45.768751] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=63) [2025-04-21 14:09:45.768771] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=16] ObSafeDestroyHandler start process [2025-04-21 14:09:45.771541] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:45.782604] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE33-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.782604] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F043C-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.783444] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE13-0-0] [lt=39] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:45.783495] WDIAG [OCCAM] dump_statistics (ob_vtable_event_recycle_buffer.h:144) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE14-0-0] [lt=37][errcode=-4006] not init(ret=-4006) [2025-04-21 14:09:45.783530] INFO [MDS] dump_map_holding_item (mds_tenant_service.cpp:478) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE14-0-0] [lt=19] finish scan map holding items(scan_cnt=0) [2025-04-21 14:09:45.783639] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE15-0-0] [lt=16] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:45.783732] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F043D-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.784602] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0440-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.784906] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0441-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.785207] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0442-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.793916] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=79] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:45.796519] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=50] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:45.799580] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:45.799607] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=25] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:45.799628] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.815376] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:45.815458] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:45.815868] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:470) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=29] skip defragment task(ret=0, need_defragment=false) [2025-04-21 14:09:45.815908] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:512) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=37] successfully defragment data blocks(ret=0, rewrite_cnt=0, block_used_size_.count()=7) [2025-04-21 14:09:45.815926] INFO [STORAGE.BLKMGR] defragment (ob_shared_macro_block_manager.cpp:530) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=16] successfully defragment data blocks(rewrite_cnt=0) [2025-04-21 14:09:45.815950] INFO [STORAGE] ~ObITabletFilterOp (ob_tablet_pointer.cpp:754) [620265][T1002_SSTableDe][T1002][Y0-0000000000000000-0-0] [lt=19] tablet skip filter destructed(total_cnt=0, skip_cnt=0, not_in_mem_cnt=0, invalid_attr_cnt=0, total_tablet_cnt=5391, total_skip_cnt=11, not_in_mem_tablet_cnt=0, invalid_attr_tablet_cnt=0) [2025-04-21 14:09:45.817854] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:45.818554] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:09:45.818615] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=51] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:45.829055] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=35] gc stale ls task succ [2025-04-21 14:09:45.840871] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:45.841821] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=33] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:45.841872] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] temporary file module use no blocks [2025-04-21 14:09:45.841896] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:45.841923] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:45.841942] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254990392041, flush_io_finished_ret_:0, flush_io_finished_round_:177, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:45.887692] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=49] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:45.888646] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] ====== tenant freeze timer task ====== [2025-04-21 14:09:45.888723] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=41] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=17) [2025-04-21 14:09:45.888754] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=27] TxData Memory Statistic : (Tenant Total Memory(MB)=5120, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=17, Freeze TxData Trigger Memory(MB)=102, Total TxDataTable Hold Memory(MB)=20, Total TxDataTable Memory Limit(MB)=1024) [2025-04-21 14:09:45.896094] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:45.896149] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.896294] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10719, max_lsn:17421629, max_scn:{val:1745215785755997000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17421629}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17421507}, last_submit_end_lsn:{lsn:17421629}, last_submit_log_id:10719, last_submit_log_pid:3, max_flushed_lsn:{lsn:17421507}, max_flushed_end_lsn:{lsn:17421629}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17421629}, last_slide_log_id:10719, last_slide_scn:{val:1745215785755997000, v:0}, last_slide_lsn:{lsn:17421507}, last_slide_end_lsn:{lsn:17421629}, last_slide_log_pid:3, last_slide_log_accum_checksum:1955325498, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10720, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17421629}, readable_log_tail:{lsn:17421629}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49683139, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:45.896543] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=242] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215785842574, last_flushed_end_lsn:{lsn:17421629}}]) [2025-04-21 14:09:45.896573] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=27] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10720, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215785842574, last_flushed_end_lsn:{lsn:17421629}}]) [2025-04-21 14:09:45.896622] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14871, max_lsn:9195163, max_scn:{val:1745215785755997000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:9195163}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:9195041}, last_submit_end_lsn:{lsn:9195163}, last_submit_log_id:14871, last_submit_log_pid:3, max_flushed_lsn:{lsn:9195041}, max_flushed_end_lsn:{lsn:9195163}, max_flushed_log_pid:3, committed_end_lsn:{lsn:9195163}, last_slide_log_id:14871, last_slide_scn:{val:1745215785755997000, v:0}, last_slide_lsn:{lsn:9195041}, last_slide_end_lsn:{lsn:9195163}, last_slide_log_pid:3, last_slide_log_accum_checksum:3633153598, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14872, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:9195163}, readable_log_tail:{lsn:9195163}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57909605, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:45.896873] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=247] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215785842613, last_flushed_end_lsn:{lsn:9195163}}]) [2025-04-21 14:09:45.896911] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=35] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14872, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215785842613, last_flushed_end_lsn:{lsn:9195163}}]) [2025-04-21 14:09:45.896962] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=5800000, clean_num=200000) [2025-04-21 14:09:45.899612] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=13][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:45.909594] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:45.910090] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDF8-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:45.912024] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00C1-0-0] [lt=37] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:45.915741] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=39] ls blacklist refresh finish(cost_time=8542) [2025-04-21 14:09:45.949712] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=60] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:45.957397] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=5518, avg_group_log_size=394) [2025-04-21 14:09:45.958577] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1250, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:45.958661] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=83] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=5640) [2025-04-21 14:09:45.958718] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:45.958776] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=5640) [2025-04-21 14:09:45.958836] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=35] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:45.958858] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1373, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:45.958879] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=1336, avg_log_submit_to_slide_time=1355) [2025-04-21 14:09:45.958916] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:45.958979] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=5640, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:45.963599] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0444-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.965246] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0446-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:45.972972] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1216, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:45.973045] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=64] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:45.973110] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=6, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:45.973147] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1312, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:45.973161] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=18, avg_log_submit_to_flush_time=1277, avg_log_submit_to_slide_time=1293) [2025-04-21 14:09:45.973196] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:45.975106] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE19-0-0] [lt=160] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:45.977287] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:45.977338] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:45.996349] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=51] LogLoopThread round_cost_time(us)(round_cost_time=701) [2025-04-21 14:09:45.999682] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.038288] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=63] PNIO [ratelimit] time: 1745215786038284, bytes: 5402763, bw: 0.013461 MB/s, add_ts: 1007637, add_bytes: 14223 [2025-04-21 14:09:46.042472] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:46.042610] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1312, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:46.042655] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:46.042708] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:46.042733] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1432, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:46.042758] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:46.043656] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=43] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:46.045870] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0449-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.046424] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F044A-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.059657] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=59] BlockGCTimerTask success(ret=0, cost_time_us=15, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:46.062512] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:46.062644] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=79] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:46.062703] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=56] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=294, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:46.062788] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:46.062910] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=66] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:46.062947] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=34] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=31, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:46.097423] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=36] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:46.099766] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.100674] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=17] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:46.100723] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.109732] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=56] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:46.112057] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=404] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7885, avg_group_log_size=606) [2025-04-21 14:09:46.112101] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:46.113719] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7885) [2025-04-21 14:09:46.113792] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7885) [2025-04-21 14:09:46.113952] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7885, hit_cnt=14, read_cnt=14, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:46.114019] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215785912185000, v:0}, new_max_version={val:1745215785912185000, v:0}, last_min_version={val:1745215785711161000, v:0}, last_max_version={val:1745215785711161000, v:0}, total_time_us=3711, delta_us=201831) [2025-04-21 14:09:46.114060] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215785912185000, v:0}, min_version={val:1745215785912185000, v:0}, max_version={val:1745215785912185000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:46.122106] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1745215786122102, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007616, add_bytes: 0 [2025-04-21 14:09:46.142800] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:46.142853] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=24, avg_log_submit_to_flush_time=1375, avg_log_submit_to_slide_time=1388) [2025-04-21 14:09:46.143335] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=1, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1352, avg_log_submit_to_slide_time=1367) [2025-04-21 14:09:46.143380] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:46.156792] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:46.156857] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=61] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:46.156899] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=40] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:46.156924] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:46.160525] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=24] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}, {obj_id:303, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:304, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:46.161272] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=741] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:46.196098] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=75] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:46.199831] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.242909] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:46.257534] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:46.297926] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:46.299919] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.309854] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:46.312029] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00C3-0-0] [lt=24] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=92) [2025-04-21 14:09:46.345180] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2B-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:46.345241] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2B-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:46.357691] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=5519) [2025-04-21 14:09:46.389386] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4139, offset=98289}, end_cursor:ObLogCursor{file_id=3, log_id=4140, offset=98595}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7787c050, len:4111, log_data_len:306, seq:4139, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:46.389773] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8E-0-0] [lt=35] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:46.389858] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8E-0-0] [lt=60] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215786257745000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215786257745000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:46.395919] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4140, offset=98595}, end_cursor:ObLogCursor{file_id=3, log_id=4141, offset=98892}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77880050, len:3805, log_data_len:297, seq:4140, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:46.396175] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8E-0-0] [lt=45] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:46.396229] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8E-0-0] [lt=38] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215786257745000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215786257745000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:46.396239] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:46.396289] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.399997] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.411772] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=31] ====== check clog disk timer task ====== [2025-04-21 14:09:46.411819] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:46.424765] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:09:46.430308] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:46.430373] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:46.430557] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:46.430759] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:46.430844] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12263, [delay/us]:prepare:16, schedule:41, submit:8, rt:1166, total:1231) [2025-04-21 14:09:46.430927] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:46.430995] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=59] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12264, [delay/us]: prepare:16, schedule:41, submit:8, device:1166, total:1231) [2025-04-21 14:09:46.431056] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=13] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:46.431130] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4088, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:570, total:585) [2025-04-21 14:09:46.431219] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:46.431262] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:570, total:585) [2025-04-21 14:09:46.431322] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=12] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:46.431350] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:46.441076] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:46.443288] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:46.443351] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=54] temporary file module use no blocks [2025-04-21 14:09:46.443371] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=17] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:46.443394] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:46.443423] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=28] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254990993521, flush_io_finished_ret_:0, flush_io_finished_round_:178, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:46.453484] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=36] ====== tenant freeze timer task ====== [2025-04-21 14:09:46.475342] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=35] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.475404] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=22] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.476068] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.476069] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.476990] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:46.477453] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:46.477507] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=47] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.478226] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=61] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:46.478329] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215781227903000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:46.495382] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0202-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.498456] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43573755904, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:46.498562] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0202-0-0] [lt=47][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254992048869, cache_obj->added_lc()=false, cache_obj->get_object_id()=768, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:46.500069] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.514901] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8500000, replace_num=100000) [2025-04-21 14:09:46.514946] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:46.553389] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=44][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26552073}], scn_array=[cnt:1, {val:1745215786513359000, v:0}], curr_size=589, accum_size=4241, time_cost=39562) [2025-04-21 14:09:46.553934] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17422361}], scn_array=[cnt:1, {val:1745215786257745002, v:0}], curr_size=122, accum_size=1098, time_cost=12208) [2025-04-21 14:09:46.554017] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9195895}], scn_array=[cnt:1, {val:1745215786257745002, v:0}], curr_size=122, accum_size=610, time_cost=12261) [2025-04-21 14:09:46.554067] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:46.574610] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=36] ====== check clog disk timer task ====== [2025-04-21 14:09:46.574655] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=38] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:46.583750] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:09:46.595435] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:46.595485] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:46.595508] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:46.595535] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:46.595559] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254991145667, flush_io_finished_ret_:0, flush_io_finished_round_:178, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:46.600162] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.600848] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=31] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:46.600894] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=39] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.605163] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=507] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:46.608067] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:46.608110] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:46.608347] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:46.609782] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215786608734000, start_id=1745215786608734000, end_id=1745215786608734001) [2025-04-21 14:09:46.609796] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:46.609824] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:46.641770] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:46.641847] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:46.644428] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=14] ====== tenant freeze timer task ====== [2025-04-21 14:09:46.644473] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:46.644562] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:46.645753] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17422483}], scn_array=[cnt:1, {val:1745215786608734000, v:0}], curr_size=546, accum_size=1644, time_cost=35861) [2025-04-21 14:09:46.645808] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1644) [2025-04-21 14:09:46.646453] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65991041}], scn_array=[cnt:1, {val:1745215786615172000, v:0}], curr_size=585, accum_size=2705, time_cost=30857) [2025-04-21 14:09:46.693331] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] [COMPACTION DAG STATUS] (start_time=1745215776690882, end_time=1745215786693327, dag_status={}) [2025-04-21 14:09:46.693381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=47] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693403] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693423] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693436] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693454] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693473] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693506] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693525] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:46.693543] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693587] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693605] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693624] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693643] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693662] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693680] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693699] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693718] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693735] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693753] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693771] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693790] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693808] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693826] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693843] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693861] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693916] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693934] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693952] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693970] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.693988] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694006] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694023] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694041] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694060] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694077] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694096] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694114] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694131] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694149] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694167] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694184] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694203] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694220] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694239] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694281] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694299] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694317] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694334] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694370] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694388] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694405] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694423] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694440] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694458] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694475] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694493] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694510] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694528] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694545] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694563] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694582] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694599] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694616] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694650] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694674] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694707] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694725] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694743] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694760] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694778] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694796] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694816] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:46.694835] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:46.694852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:46.694869] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:46.694885] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:46.694900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:46.694914] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:46.694929] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:46.694944] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:46.694959] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:46.694974] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:46.694990] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:46.695010] INFO [COMMON] loop_running_dag_net_list (ob_tenant_dag_scheduler.cpp:3759) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] loop running dag net list(ret=0, running_dag_net_list_size=0, slow_dag_net_cnt=0, finished_dag_net_list_size=0) [2025-04-21 14:09:46.695029] INFO [COMMON] loop_finished_dag_net_list (ob_tenant_dag_scheduler.cpp:3782) [620255][T1002_DagSchedu][T1002][Y0-0000000000000000-0-0] [lt=18] loop finsihed dag net list(ret=0, finished_dag_net_list_size=0) [2025-04-21 14:09:46.695149] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695541] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695582] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695704] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695727] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695789] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695808] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.695881] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.696123] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.696176] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.696199] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:46.698974] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:46.700252] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.707554] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=19] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:46.708762] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:46.708856] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=37] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215785621567000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:46.708901] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215785621567000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1, freeze_info:{latest_snapshot_gc_scn:{val:1745215785621567000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:46.713907] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=39] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7775) [2025-04-21 14:09:46.715061] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=17] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:46.741846] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:46.741900] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1644, avg_group_log_size=164) [2025-04-21 14:09:46.742034] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=130] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1644) [2025-04-21 14:09:46.742060] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:46.742102] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:46.742126] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:46.743150] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=86] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2700, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:46.743199] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:46.743217] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=63] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:46.743255] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=36] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2810, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:46.743283] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:46.758237] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=60] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215786758221], gts:1745215786757635000, latest_srr:[mts=1745215786758221]}) [2025-04-21 14:09:46.772121] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:46.783452] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F044E-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.785932] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0451-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.786006] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDCB-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.786006] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE35-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.786400] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=31] get number(ret=0, service_type_=0, range=1, base_id=1745215786785468000, start_id=1745215786785468000, end_id=1745215786785468001) [2025-04-21 14:09:46.787319] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0454-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.787406] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE37-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.787572] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0455-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.788357] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0456-0-0] [lt=18][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.796630] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:46.800322] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.813396] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=27] ====== traversal_flush timer task ====== [2025-04-21 14:09:46.813495] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDAA-0-0] [lt=39] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:46.813619] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDAA-0-0] [lt=118] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:46.814255] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1, min_version={val:1745215786615172000, v:0}, base_version={val:1745215786414775000, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215786615172000, v:0}, valid_part_count:1, total_part_count:1, generate_tstamp:1745215786814230, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:46.816021] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:46.816094] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:46.829125] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:46.841051] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=52] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:46.842075] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:46.842126] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=42] temporary file module use no blocks [2025-04-21 14:09:46.842148] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:46.842174] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:46.842198] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254991392300, flush_io_finished_ret_:0, flush_io_finished_round_:178, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:46.860105] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=22] ====== checkpoint timer task ====== [2025-04-21 14:09:46.861068] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:46.861127] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=57] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:46.861198] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:46.861299] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=97] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:46.861346] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:46.861372] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215778608332001, v:0}) [2025-04-21 14:09:46.861390] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:46.861408] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:46.861431] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:46.861463] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:46.861485] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:46.861514] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=20][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:46.861548] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=32] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:46.861568] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:46.878658] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=78] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:46.896376] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:46.896424] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.899441] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:46.900344] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:46.913849] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00C6-0-0] [lt=35] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:46.915195] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:46.930567] INFO [STORAGE] runTimerTask (ob_locality_manager.cpp:708) [619602][LocalityReload][T0][Y0-0000000000000000-0-0] [lt=34] runTimer to refresh locality_info(ret=0) [2025-04-21 14:09:46.932290] INFO [SHARE] set_server_locality_array (ob_server_locality_cache.cpp:346) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=30] set_server_locality_array success(server_locality_array=[{inited:true, addr:"11.29.122.182:2882", zone:"zone1", zone_type:0, idc:"", region:"sys_region", is_active:true, start_service_time:1745215621947340, server_stop_time:0, server_status:1}], has_readonly_zone=false) [2025-04-21 14:09:46.932364] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=62] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1, primary_zone=RANDOM) [2025-04-21 14:09:46.932397] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=32] add_locality_zone success(locality_zone={tenant_id:1, region_priority:18446744073709551615}) [2025-04-21 14:09:46.932417] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1001, primary_zone=RANDOM) [2025-04-21 14:09:46.932436] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=17] add_locality_zone success(locality_zone={tenant_id:1001, region_priority:18446744073709551615}) [2025-04-21 14:09:46.932458] INFO [SHARE] load_region (ob_locality_table_operator.cpp:336) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=16] tenant_schema primary_zone is NULL, or no need calc region priority(tenant_id=1002, primary_zone=RANDOM) [2025-04-21 14:09:46.932474] INFO [SHARE] load_region (ob_locality_table_operator.cpp:363) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] add_locality_zone success(locality_zone={tenant_id:1002, region_priority:18446744073709551615}) [2025-04-21 14:09:46.932492] INFO [SHARE] load_region (ob_locality_table_operator.cpp:373) [619601][LocltyRefTask][T0][Y0-0000000000000000-0-0] [lt=15] load region(ret=0, locality_info={version:0, local_region:"sys_region", local_zone:"zone1", local_idc:"", local_zone_type:0, local_zone_status:2, locality_region_array:[{region:"sys_region", region_priority:18446744073709551615, zone_array:["zone1"]}], locality_zone_array:[{tenant_id:1, region_priority:18446744073709551615}, {tenant_id:1001, region_priority:18446744073709551615}, {tenant_id:1002, region_priority:18446744073709551615}]}) [2025-04-21 14:09:46.944887] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD96-0-0] [lt=30] [LS_LOCATION]dump tenant ls location caches(tenant_id=1, tenant_ls_locations=[{cache_key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215782045073, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:46.944941] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD96-0-0] [lt=52] [LS_LOCATION]dump tenant ls location caches(tenant_id=1001, tenant_ls_locations=[{cache_key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215782047041, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:46.944963] INFO [SHARE.LOCATION] dump_cache (ob_ls_location_service.cpp:1230) [619591][DumpLSLoc][T0][YB420B1D7AB6-00063343B6FEFD96-0-0] [lt=20] [LS_LOCATION]dump tenant ls location caches(tenant_id=1002, tenant_ls_locations=[{cache_key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, renew_time:1745215782048436, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}, {cache_key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, renew_time:1745215782048431, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}]}]) [2025-04-21 14:09:46.958130] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3534, avg_group_log_size=353) [2025-04-21 14:09:46.959297] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=69] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4192, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:46.959337] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:46.959362] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:46.959402] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:46.959442] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:46.959461] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4311, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:46.959474] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=11] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=20, avg_log_submit_to_flush_time=4270, avg_log_submit_to_slide_time=4290) [2025-04-21 14:09:46.959503] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:46.959537] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=54, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:46.959558] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=20] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=2087, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:46.959575] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:46.959592] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=-530, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:46.959610] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=48, stat_interval=5000000, avg (count/cost)=1611, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:46.959640] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:46.962190] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=51] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:46.966141] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=43][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:46.966343] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0458-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.966392] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=38] current monitor number(seq_=-1) [2025-04-21 14:09:46.967838] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F045A-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:46.973404] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=4471, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:46.973453] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:46.973505] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:46.973532] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=4572, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:46.973553] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:46.977606] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:46.977654] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=40] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:46.994077] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=42] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:47.000416] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.017341] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=32] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:47.036326] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=71] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:47.039169] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:47.039208] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=38] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:47.039214] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC9-0-0] [lt=29] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:47.039263] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDC9-0-0] [lt=46] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:47.043336] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5883, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:47.043400] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=24, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:47.043401] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1842) [2025-04-21 14:09:47.043469] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:47.043504] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5989, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:47.043529] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:47.043780] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=39] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:47.045886] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1745215787045882, bytes: 5416340, bw: 0.012850 MB/s, add_ts: 1007598, add_bytes: 13577 [2025-04-21 14:09:47.049688] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F045D-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.050251] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F045E-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.099912] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:47.100486] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.101033] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:47.101088] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.114121] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7775, avg_group_log_size=647) [2025-04-21 14:09:47.114167] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:47.115330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:47.115567] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7775) [2025-04-21 14:09:47.115638] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7775) [2025-04-21 14:09:47.115685] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=4, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=4304, avg_log_submit_to_slide_time=4322) [2025-04-21 14:09:47.115767] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7775, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:47.115807] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215786913486000, v:0}, new_max_version={val:1745215786913486000, v:0}, last_min_version={val:1745215786713682000, v:0}, last_max_version={val:1745215786713682000, v:0}, total_time_us=3197, delta_us=202319) [2025-04-21 14:09:47.115844] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215786913486000, v:0}, min_version={val:1745215786913486000, v:0}, max_version={val:1745215786913486000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:47.129757] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=36] PNIO [ratelimit] time: 1745215787129754, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007652, add_bytes: 0 [2025-04-21 14:09:47.143452] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=2726, avg_log_submit_to_slide_time=2745) [2025-04-21 14:09:47.143545] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1842, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:47.143605] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1644) [2025-04-21 14:09:47.143652] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=21, avg_log_submit_to_flush_time=5953, avg_log_submit_to_slide_time=5965) [2025-04-21 14:09:47.158183] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=43] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:47.158221] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=35] try gc retain ctx [2025-04-21 14:09:47.158235] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=13] try to retry start_working [2025-04-21 14:09:47.158279] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=21] finish update min start scn(max_decided_scn={val:1745215787015305000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215777007108001, v:0}, keep_alive_scn_:{val:1745215782011153001, v:0}, update_ts_:1745215787157493}) [2025-04-21 14:09:47.159244] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215795197259000, latest_log_ts:{val:1745215778608332001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:47.200557] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.212719] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215787113714000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215787212676}, version_delta=99003) [2025-04-21 14:09:47.214569] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215787015305000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199247, in_cluster_service=true, cluster_version={val:1745215786813379000, v:0}, min_cluster_version={val:1745215786813379000, v:0}, max_cluster_version={val:1745215786813379000, v:0}, get_cluster_version_err=0, cluster_version_delta=401173, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1660, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=124744689, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:47.243635] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:09:47.258504] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=56] ts response task statistics(alloc_count=4038, free_count=2018) [2025-04-21 14:09:47.258555] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=38] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=349, get_gts_with_stc_cnt=30, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=29, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:47.258577] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=20] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:47.264373] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDC-0-0] [lt=40] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:47.264417] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDC-0-0] [lt=37] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=46) [2025-04-21 14:09:47.300444] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:47.300645] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.315464] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:47.347039] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2C-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:47.347098] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2C-0-0] [lt=57] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:47.396522] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:47.396589] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.400716] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.402016] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=39] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4141, offset=98892}, end_cursor:ObLogCursor{file_id=3, log_id=4142, offset=99198}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77884050, len:3508, log_data_len:306, seq:4141, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:47.402419] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8F-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:47.402487] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8F-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215787258175000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215787258175000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:47.408626] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=58] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4142, offset=99198}, end_cursor:ObLogCursor{file_id=3, log_id=4143, offset=99495}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77888050, len:3202, log_data_len:297, seq:4142, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:47.408892] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8F-0-0] [lt=37] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:47.408949] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE8F-0-0] [lt=41] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215787258175000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215787258175000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:47.416217] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3525) [2025-04-21 14:09:47.424834] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:47.432309] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:47.432388] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=51] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:47.432587] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=27] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:47.432779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:47.432875] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8175, [delay/us]:prepare:16, schedule:40, submit:7, rt:1299, total:1363) [2025-04-21 14:09:47.432949] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:47.433027] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=70] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:16, schedule:40, submit:7, device:1299, total:1363) [2025-04-21 14:09:47.433085] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=14] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:47.433229] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:602, total:617) [2025-04-21 14:09:47.433328] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=28] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:47.433370] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:602, total:617) [2025-04-21 14:09:47.433430] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:47.433456] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:47.441241] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=47] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:47.443545] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:47.443603] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:47.443625] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=20] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:47.443653] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=24] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:47.443682] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254991993785, flush_io_finished_ret_:0, flush_io_finished_round_:179, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:47.475429] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.475510] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.475945] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.476161] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.477812] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=16] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:47.477872] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.500762] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.500980] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:47.502304] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0204-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.504745] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0204-0-0] [lt=39][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254993055053, cache_obj->added_lc()=false, cache_obj->get_object_id()=769, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:47.515609] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:47.541487] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=72] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:47.583841] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:47.595699] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=59] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:47.595757] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:47.595775] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:47.595796] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:47.595822] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254992145936, flush_io_finished_ret_:0, flush_io_finished_round_:179, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:47.600828] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.601245] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=22] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:47.601304] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=49] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.603024] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=24] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:47.603078] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=37] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=36) [2025-04-21 14:09:47.605325] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:47.608575] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:47.608635] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:47.610470] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:47.610507] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:47.618398] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1745215787617855000, start_id=1745215787617855000, end_id=1745215787617855001) [2025-04-21 14:09:47.642526] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:47.642593] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:47.644177] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1766, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:47.690341] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=66] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585262542848, fast_delete_log_mode=false) [2025-04-21 14:09:47.695141] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695211] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=43] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695310] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695448] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695673] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695725] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695894] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695909] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.695957] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=30] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.696284] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=28] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.696401] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=34] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:47.700901] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.701510] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:47.714898] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] get number(ret=0, service_type_=0, range=1, base_id=1745215787714263000, start_id=1745215787714263000, end_id=1745215787714263001) [2025-04-21 14:09:47.715027] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7774) [2025-04-21 14:09:47.715740] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:47.742572] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:47.742635] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:47.742665] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:47.742709] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:47.742756] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:47.742780] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:47.744237] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1378, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:47.744288] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:47.744334] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:47.744378] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1494, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:47.744403] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=55, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:47.744439] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1342) [2025-04-21 14:09:47.747478] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDDF-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:47.752189] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:47.759010] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215787758132000, start_id=1745215787758132000, end_id=1745215787758132001) [2025-04-21 14:09:47.759084] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=45] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215787759073], gts:1745215787758132000, latest_srr:[mts=1745215787759073]}) [2025-04-21 14:09:47.773019] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:47.788593] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDCD-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.788594] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE38-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.788606] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0460-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.790460] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0462-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.790492] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE3A-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.790525] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDCF-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.796745] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=39] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:47.800981] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.816805] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:47.816868] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:47.818732] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:47.818779] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:47.829200] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:47.833685] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:47.834998] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:47.835092] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215778810123000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:47.835136] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=39] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215778810123000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1001, freeze_info:{latest_snapshot_gc_scn:{val:1745215778810123000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:47.841214] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:47.880054] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9198103}], scn_array=[cnt:1, {val:1745215787759202000, v:0}], curr_size=122, accum_size=976, time_cost=37319) [2025-04-21 14:09:47.880125] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17424371}], scn_array=[cnt:1, {val:1745215787759202000, v:0}], curr_size=122, accum_size=122, time_cost=37442) [2025-04-21 14:09:47.890045] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=23] ====== tenant freeze timer task ====== [2025-04-21 14:09:47.896705] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:47.896760] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.901073] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:47.901986] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:47.909690] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=42][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:47.911114] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=6000000, clean_num=200000) [2025-04-21 14:09:47.914826] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00CB-0-0] [lt=33] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965492248535156250e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.977590659871550542e+02) [2025-04-21 14:09:47.915861] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=40] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:47.926765] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=40] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:47.933521] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=44] LogLoopThread round_cost_time(us)(round_cost_time=16) [2025-04-21 14:09:47.958839] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=100] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3403, avg_group_log_size=378) [2025-04-21 14:09:47.960033] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1314, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:47.960083] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3403) [2025-04-21 14:09:47.960120] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:47.960165] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3403) [2025-04-21 14:09:47.960207] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=28] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:47.960227] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1431, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:47.960245] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=22, avg_log_submit_to_flush_time=1392, avg_log_submit_to_slide_time=1409) [2025-04-21 14:09:47.960277] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:47.960311] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3403, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:47.968900] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0464-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.970633] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0466-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:47.974827] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1485, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:47.974886] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:47.974947] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:47.974978] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1608, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:47.975002] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:47.977997] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:47.978068] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=61] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:47.989287] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=50] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:48.001146] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.043922] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:48.044099] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=77] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:48.044163] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5158, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:48.044213] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:48.044304] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=7, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:48.044346] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5288, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:48.044364] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:48.053527] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215788053520, bytes: 5429758, bw: 0.012699 MB/s, add_ts: 1007638, add_bytes: 13418 [2025-04-21 14:09:48.054388] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0469-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.055083] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F046A-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.067252] INFO [SHARE.LOCATION] renew_all_ls_locations_by_rpc (ob_ls_location_service.cpp:801) [619590][AutoLSLocRpc][T0][YB420B1D7AB6-00063343B43EFE30-0-0] [lt=80] [LS_LOCATION] Get ls leaders by RPC(ret=0, ret="OB_SUCCESS", dests=["11.29.122.182:2882"], leaders=[{key:{tenant_id:1, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1001, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}, {key:{tenant_id:1002, ls_id:{id:1001}, cluster_id:1745213817}, location:{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, property:{memstore_percent_:100}, restore_status:{status:0}, proposal_id:3}}]) [2025-04-21 14:09:48.101213] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.101460] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:48.101518] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.111622] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=29] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:48.115283] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7773, avg_group_log_size=647) [2025-04-21 14:09:48.115332] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:48.115986] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=39] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:48.117045] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7773) [2025-04-21 14:09:48.117135] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7773) [2025-04-21 14:09:48.117180] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1593, avg_log_submit_to_slide_time=1610) [2025-04-21 14:09:48.117247] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7773, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:48.117331] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=19] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215787914281000, v:0}, new_max_version={val:1745215787914281000, v:0}, last_min_version={val:1745215787714263000, v:0}, last_max_version={val:1745215787714263000, v:0}, total_time_us=3905, delta_us=203048) [2025-04-21 14:09:48.117369] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=36] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215787914281000, v:0}, min_version={val:1745215787914281000, v:0}, max_version={val:1745215787914281000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:48.137349] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=41] PNIO [ratelimit] time: 1745215788137339, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007585, add_bytes: 0 [2025-04-21 14:09:48.144523] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:48.144603] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=58] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=5267, avg_log_submit_to_slide_time=5282) [2025-04-21 14:09:48.144659] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=5142, avg_log_submit_to_slide_time=5165) [2025-04-21 14:09:48.144690] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:48.201280] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.204983] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=74] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:48.219104] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=14] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:48.244859] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:48.259531] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=28] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215788259497], gts:1745215788259436000, latest_srr:[mts=1745215788259497]}) [2025-04-21 14:09:48.259595] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=62] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:48.301361] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.312121] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=79] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:48.316128] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:48.348859] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2D-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:48.348916] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2D-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:48.373442] INFO [STORAGE.TRANS] refresh_elr_tenant_config_ (ob_tx_elr_util.cpp:47) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F00D7-0-0] [lt=63] refresh tenant config success(tenant_id=1001, *this={last_refresh_ts:1745215788373226, can_tenant_elr:true}) [2025-04-21 14:09:48.375421] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=26569242, this={dio_aligned_buf:{buf_write_offset:3175, buf_padding_size:921, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:7242, truncate_used_ts:2980}, log_block_size:67108864, dir_fd:139, io_fd:140}, aligned_buf_len=4096, aligned_block_offset=26566656, buf_len=589, total_write_size=79252, total_write_size_after_dio=598016, ob_pwrite_used_ts=256147, count=127, each_pwrite_cost=2016) [2025-04-21 14:09:48.396891] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:48.396961] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.401442] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.411926] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=26] ====== check clog disk timer task ====== [2025-04-21 14:09:48.411983] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:48.415108] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4143, offset=99495}, end_cursor:ObLogCursor{file_id=3, log_id=4144, offset=99801}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7788c050, len:2905, log_data_len:306, seq:4143, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:48.415599] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE90-0-0] [lt=50] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:48.415806] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE90-0-0] [lt=134] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215788259436000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215788259436000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:48.417512] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3412) [2025-04-21 14:09:48.419182] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE90-0-0] [lt=40] get number(ret=0, service_type_=0, range=1, base_id=1745215788418422000, start_id=1745215788418422000, end_id=1745215788418422001) [2025-04-21 14:09:48.421839] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=77] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4144, offset=99801}, end_cursor:ObLogCursor{file_id=3, log_id=4145, offset=100098}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77890050, len:2599, log_data_len:297, seq:4144, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:48.422154] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE90-0-0] [lt=84] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:48.422231] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE90-0-0] [lt=49] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215788259436000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215788259436000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:48.424919] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=37] gc stale ls task succ [2025-04-21 14:09:48.434506] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:48.434572] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=44] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:48.434765] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:48.434949] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:48.435032] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:45, submit:8, rt:1407, total:1478) [2025-04-21 14:09:48.435107] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:48.435172] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=57] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:17, schedule:45, submit:8, device:1407, total:1478) [2025-04-21 14:09:48.435226] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:48.435300] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:743, total:756) [2025-04-21 14:09:48.435395] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:48.435435] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:743, total:756) [2025-04-21 14:09:48.435494] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:48.435519] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:48.441399] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:48.443803] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:48.443859] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] temporary file module use no blocks [2025-04-21 14:09:48.443877] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:48.443897] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:48.443921] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254992994043, flush_io_finished_ret_:0, flush_io_finished_round_:180, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:48.454941] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:48.455020] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=41] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=17) [2025-04-21 14:09:48.455049] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=26] TxData Memory Statistic : (Tenant Total Memory(MB)=1024, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=17, Freeze TxData Trigger Memory(MB)=20, Total TxDataTable Hold Memory(MB)=20, Total TxDataTable Memory Limit(MB)=204) [2025-04-21 14:09:48.475263] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.475545] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=57] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.475605] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=23] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.476034] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.478239] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:48.478302] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=50] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.501528] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.508938] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0206-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.511440] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0206-0-0] [lt=45][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254994061746, cache_obj->added_lc()=false, cache_obj->get_object_id()=770, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:48.512624] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:48.516273] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:48.557685] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:138) [620317][T1002_Compactio][T1002][YB420B1D7AB6-00063343B84EFD8B-0-0] [lt=50] InfoPoolResizeTask(cost_ts=22) [2025-04-21 14:09:48.559820] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620262][T1002_TntShared][T1002][Y0-0000000000000000-0-0] [lt=54] clear dtl interm result cost(us)(clear_cost=447, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:48.570778] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=15] ====== traversal_flush timer task ====== [2025-04-21 14:09:48.570904] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA9-0-0] [lt=42] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215788259436001, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:48.571067] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA9-0-0] [lt=125] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:48.571146] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDA9-0-0] [lt=74] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:48.574796] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=18] ====== check clog disk timer task ====== [2025-04-21 14:09:48.574839] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=36] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:48.583914] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:48.601606] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.601654] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:48.601707] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.605486] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:48.608468] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=31][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:48.608512] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:48.610261] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:48.610298] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:48.617247] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] submit log success(service_type_=0, last_id=1745215805197259000, limited_id=1745215805197259000) [2025-04-21 14:09:48.617285] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] submit log with lock success(service_type_=0, last_id=1745215805197259000, limited_id=1745215805197259000) [2025-04-21 14:09:48.618800] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=48] update id meta(ret=0, service_type=0, limited_id=1745215805197259000, latest_scn={val:1745215788616704001, v:0}, *this={tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215805197259000, latest_log_ts:{val:1745215788616704001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:48.618882] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=80] handle submit callback(service_type_=0, success=true, used_ts=1637, log_ts={val:1745215788616704001, v:0}, limited_id=1745215805197259000) [2025-04-21 14:09:48.618908] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=24] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:48.618941] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF01FE-0-0] [lt=32] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:48.622277] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=27][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:48.622397] WDIAG read_multi_row (ob_table_access_helper.h:238) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1002, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:48.623982] INFO delete_row (ob_table_access_helper.h:312) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=36] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1002, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215788622435) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215788622435) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:48.624121] INFO [STORAGE.TABLELOCK] garbage_collect_for_all_ls_ (ob_table_lock_service.cpp:348) [620290][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] finish check and clear obj lock(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:48.643320] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:48.643373] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:48.644559] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:48.645888] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=32] ====== tenant freeze timer task ====== [2025-04-21 14:09:48.645936] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=39] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:48.645980] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=26] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:48.681177] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=13] ====== checkpoint timer task ====== [2025-04-21 14:09:48.682220] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=44] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:48.682284] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=62] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:48.682375] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:48.682484] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=105] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:48.682520] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:48.682549] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] get rec log scn(service_type_=0, rec_log_ts={val:1745215784255499001, v:0}) [2025-04-21 14:09:48.682571] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:48.682596] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:48.682630] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:48.682654] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:48.682710] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:48.682747] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:48.683736] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:48.683776] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=40] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:48.683833] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=27] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:48.683904] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=69] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:48.683922] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:48.683940] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:48.683965] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:48.683987] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:48.684010] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:48.684037] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=26] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:48.684058] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:48.695221] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=44] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695225] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=45] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695295] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695718] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695866] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695865] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.695976] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.696000] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.696073] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.696369] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.696541] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:48.701691] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.713175] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:48.715517] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7770) [2025-04-21 14:09:48.721353] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8600000, replace_num=100000) [2025-04-21 14:09:48.721400] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:48.737349] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=56] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:48.743375] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:48.743433] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:48.743468] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:48.743491] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:48.743534] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:48.743570] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:48.744701] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:48.744773] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4983, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:48.744821] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:48.744839] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:48.744882] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=5128, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:48.744906] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:48.755237] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE19-0-0] [lt=35] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:48.758103] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0208-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.760675] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0208-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254994310982, cache_obj->added_lc()=false, cache_obj->get_object_id()=771, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:48.762003] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF020C-0-0] [lt=37][errcode=-4201] hashtable not init [2025-04-21 14:09:48.762037] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF020C-0-0] [lt=33] get cursor info failed(cursor_id=53, get_sessid()=3221487630) [2025-04-21 14:09:48.762176] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=23] get number(ret=0, service_type_=0, range=1, base_id=1745215788761544000, start_id=1745215788761544000, end_id=1745215788761544001) [2025-04-21 14:09:48.764615] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDAB-0-0] [lt=49] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:48.773757] INFO [STORAGE.TRANS] create_tx_ctx_ (ob_trans_ctx_mgr_v4.cpp:419) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F00D9-0-0] [lt=50] transaction statistics(ls_id={id:1}, total_count=1) [2025-04-21 14:09:48.773945] INFO [STORAGE.TRANS] get_tx_ctx_ (ob_trans_ctx_mgr_v4.cpp:496) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] transaction statistics(ls_id={id:1}, total_tx_ctx_count=1) [2025-04-21 14:09:48.774037] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=31] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:48.785782] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE17-0-0] [lt=21] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:48.791689] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F046C-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.791693] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE3B-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.791698] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD0-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.793661] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE3D-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.793673] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F046E-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.793673] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD2-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.796920] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=93] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:48.801822] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=53] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:48.801851] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:48.801872] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.817862] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=15] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:48.817941] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:48.829282] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=49] gc stale ls task succ [2025-04-21 14:09:48.830289] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:65999251}], scn_array=[cnt:1, {val:1745215788817314000, v:0}], curr_size=585, accum_size=3978, time_cost=12320) [2025-04-21 14:09:48.841448] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:48.842421] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=41] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:48.842477] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=46] temporary file module use no blocks [2025-04-21 14:09:48.842496] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:48.842518] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:48.842543] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254993392662, flush_io_finished_ret_:0, flush_io_finished_round_:180, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:48.843404] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=29] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:48.843454] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] try gc retain ctx [2025-04-21 14:09:48.843476] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] try to retry start_working [2025-04-21 14:09:48.843543] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] finish update min start scn(max_decided_scn={val:1745215788259436004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215778749924000, v:0}, keep_alive_scn_:{val:1745215783754395000, v:0}, update_ts_:1745215788843260}) [2025-04-21 14:09:48.844559] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:48.844767] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=119] finish update min start scn(max_decided_scn={val:1745215788259436004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215778749924000, v:0}, keep_alive_scn_:{val:1745215783754395000, v:0}, update_ts_:1745215788844327}) [2025-04-21 14:09:48.845834] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215786257745000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:48.865539] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9199323}], scn_array=[cnt:1, {val:1745215788759369000, v:0}], curr_size=113, accum_size=967, time_cost=19550) [2025-04-21 14:09:48.865690] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17425591}], scn_array=[cnt:1, {val:1745215788759369000, v:0}], curr_size=113, accum_size=113, time_cost=20941) [2025-04-21 14:09:48.866183] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=60][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26569973}], scn_array=[cnt:1, {val:1745215788818388001, v:0}], curr_size=815, accum_size=6819, time_cost=46773) [2025-04-21 14:09:48.887066] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=62] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:48.897056] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:48.897113] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.901834] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=18][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:48.908870] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDFA-0-0] [lt=32] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12239, add_timestamp:1745215788908841}) [2025-04-21 14:09:48.908962] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDFA-0-0] [lt=64] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12287, add_timestamp:1745215788908955}) [2025-04-21 14:09:48.908951] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4D-0-0] [lt=44] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12239, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215788908919, sql_renew_time:1745215788908919, is_mark_fail:false}]) [2025-04-21 14:09:48.908999] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4D-0-0] [lt=46] success to process renew task(task={tenant_id:1, table_id:12239, add_timestamp:1745215788908841}, locations=[{table_id:12239, partition_id:12239, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215788908919, sql_renew_time:1745215788908919, is_mark_fail:false}]) [2025-04-21 14:09:48.909061] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4E-0-0] [lt=49] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12287, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:48.909452] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4E-0-0] [lt=23] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12287, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215788909440, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:48.909486] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4E-0-0] [lt=34] success to process renew task(task={tenant_id:1, table_id:12287, add_timestamp:1745215788908955}, locations=[{table_id:12287, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215788909440, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:48.910823] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDFA-0-0] [lt=27] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:48.913663] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:48.917441] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=47] start to print blacklist info [2025-04-21 14:09:48.917666] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=52] ls blacklist refresh finish(cost_time=10302) [2025-04-21 14:09:48.921513] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=19] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:48.929904] INFO [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:263) [620322][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF6EFD86-0-0] [lt=45] ObArchiveSender is running(thread_index=1) [2025-04-21 14:09:48.955725] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:48.957078] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620120][T1001_ReqMemEvi][T1001][YB420B1D7AB6-00063343AEBEFDAA-0-0] [lt=38] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.941644191741943359e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=397, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=7.061255481049461196e+02) [2025-04-21 14:09:48.957269] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=54] get number(ret=0, service_type_=0, range=1, base_id=1745215788956676000, start_id=1745215788956676000, end_id=1745215788956676001) [2025-04-21 14:09:48.959551] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=4100, avg_group_log_size=372) [2025-04-21 14:09:48.960732] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=64] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2259, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:48.960775] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4100) [2025-04-21 14:09:48.960803] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:48.960837] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4100) [2025-04-21 14:09:48.960894] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:48.960918] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=2536, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:48.960936] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=132, avg_log_gen_to_submit_time=152, avg_log_submit_to_flush_time=2363, avg_log_submit_to_slide_time=2384) [2025-04-21 14:09:48.960968] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=47, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:48.961024] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4100, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:48.966629] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=33] current monitor number(seq_=-1) [2025-04-21 14:09:48.971763] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0470-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.973426] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0472-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:48.975551] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=49] [PALF STAT WRITE LOG COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=4865, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:48.975598] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:48.975647] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:48.975672] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=4974, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:48.975694] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=41, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:48.977316] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE1B-0-0] [lt=42] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:48.978410] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:48.978463] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:48.979274] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=41] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:49.001918] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.018454] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215789017845000, start_id=1745215789017845000, end_id=1745215789017845001) [2025-04-21 14:09:49.040329] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=25] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:49.040387] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=57] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:49.040390] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD97-0-0] [lt=25] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:49.040439] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD97-0-0] [lt=44] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:49.044074] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=58] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:49.045863] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:49.046040] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3511, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:49.046089] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:49.046131] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:49.046159] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3626, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:49.046178] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:49.059337] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0475-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.060208] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0476-0-0] [lt=61][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.061143] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=67] PNIO [ratelimit] time: 1745215789061138, bytes: 5443828, bw: 0.013317 MB/s, add_ts: 1007618, add_bytes: 14070 [2025-04-21 14:09:49.063121] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=33] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:49.063224] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=58] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:49.063251] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=24] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=299, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:49.063302] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:49.063364] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:49.063381] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=16] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=31, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:49.072476] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=30] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215788759369000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=313097, in_cluster_service=true, cluster_version={val:1745215788259436004, v:0}, min_cluster_version={val:1745215788259436004, v:0}, max_cluster_version={val:1745215788259436004, v:0}, get_cluster_version_err=0, cluster_version_delta=813030, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1643, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=119948202, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:49.088633] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=20] dump tenant info(tenant={id:1, tenant_meta:{unit:{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"3.000000000000000000e+00", unit_max_cpu:"3.000000000000000000e+00", total_worker_cnt:53, min_worker_cnt:32, max_worker_cnt:150, stopped:0, worker_us:142717679, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:122, recv_lp_rpc_cnt:0, recv_mysql_cnt:1508, recv_task_cnt:149, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:557171, workers:32, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=5 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:25, queue_size:0, recv_req_cnt:86, min_worker_cnt:1, max_worker_cnt:1, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617187507}{group_id:10, queue_size:0, recv_req_cnt:172, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215617940785}{group_id:20, queue_size:0, recv_req_cnt:175, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215686341138}{group_id:2, queue_size:0, recv_req_cnt:702, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215612768387}{group_id:9, queue_size:0, recv_req_cnt:124, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215602794046}{group_id:5, queue_size:0, recv_req_cnt:5, min_worker_cnt:3, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:3, nesting_worker_cnt:0, token_change:1745215615208257}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x4a9:cnt=10 pcode=0x152:cnt=5 pcode=0x40e:cnt=5, token_change_ts:1745215601830622, tenant_role:1}) [2025-04-21 14:09:49.089462] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=827] dump throttled time info(id_=1, throttled_time_log=group_id: 25, group: OBCG_HB_SERVICE, throttled_time: 0;group_id: 10, group: OBCG_LOC_CACHE, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 9, group: OBCG_DETECT_RS, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1, tenant_throttled_time: 0;) [2025-04-21 14:09:49.089500] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=38] dump tenant info(tenant={id:508, tenant_meta:{unit:{tenant_id:508, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:5, max_cpu:5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:5, }}, mode:0, create_timestamp:1745215598936233, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:508, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"5.000000000000000000e+00", unit_max_cpu:"5.000000000000000000e+00", total_worker_cnt:60, min_worker_cnt:52, max_worker_cnt:150, stopped:0, worker_us:11937079, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:939257, workers:52, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598952513, tenant_role:0}) [2025-04-21 14:09:49.090172] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=670] dump throttled time info(id_=508, throttled_time_log=tenant_id: 508, tenant_throttled_time: 0;) [2025-04-21 14:09:49.090188] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=15] dump tenant info(tenant={id:509, tenant_meta:{unit:{tenant_id:509, unit_id:1000, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1000, name:"virtual_tenant_unit", resource:{min_cpu:2.5, max_cpu:2.5, memory_size:"1GB", log_disk_size:"2GB", data_disk_size:0, min_iops:10000, max_iops:50000, iops_weight:0, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:2, }}, mode:0, create_timestamp:1745215598924252, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:509, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:true, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"2.500000000000000000e+00", unit_max_cpu:"2.500000000000000000e+00", total_worker_cnt:35, min_worker_cnt:27, max_worker_cnt:150, stopped:0, worker_us:6936139, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:0, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:469599, workers:27, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:, rpc_stat_info:, token_change_ts:1745215598974352, tenant_role:0}) [2025-04-21 14:09:49.090838] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=650] dump throttled time info(id_=509, throttled_time_log=tenant_id: 509, tenant_throttled_time: 0;) [2025-04-21 14:09:49.091226] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=386] dump tenant info(tenant={id:1001, tenant_meta:{unit:{tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1001, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:44564277, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:165, recv_lp_rpc_cnt:0, recv_mysql_cnt:0, recv_task_cnt:0, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:73214, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:20, queue_size:0, recv_req_cnt:438, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215690184189}{group_id:2, queue_size:0, recv_req_cnt:690, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215615598643}{group_id:5, queue_size:0, recv_req_cnt:9, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215617970930}, rpc_stat_info: pcode=0x150b:cnt=20 pcode=0x150a:cnt=20 pcode=0x745:cnt=10, token_change_ts:1745215604411024, tenant_role:1}) [2025-04-21 14:09:49.091827] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=600] dump throttled time info(id_=1001, throttled_time_log=group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;group_id: 5, group: OBCG_ID_SERVICE, throttled_time: 0;tenant_id: 1001, tenant_throttled_time: 0;) [2025-04-21 14:09:49.091856] INFO [SERVER.OMT] run1 (ob_multi_tenant.cpp:2621) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=29] dump tenant info(tenant={id:1002, tenant_meta:{unit:{tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, super_block:{tenant_id:1002, replay_start_point:ObLogCursor{file_id=1, log_id=1, offset=0}, ls_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, tablet_meta_entry:{[ver=1,mode=0,seq=0][2nd=18446744073709551615]}, is_hidden:false, version:4, snapshot_cnt:0, preallocated_seqs:{object_seq:60000, tmp_file_seq:60000, write_seq:60000}, auto_inc_ls_epoch:0, ls_cnt:0}, create_status:1, epoch:0}, unit_min_cpu:"1.000000000000000000e+00", unit_max_cpu:"1.000000000000000000e+00", total_worker_cnt:16, min_worker_cnt:6, max_worker_cnt:150, stopped:0, worker_us:73351865, recv_hp_rpc_cnt:0, recv_np_rpc_cnt:27, recv_lp_rpc_cnt:0, recv_mysql_cnt:2299, recv_task_cnt:54, recv_large_req_cnt:0, tt_large_quries:0, pop_normal_cnt:75071, workers:6, nesting workers:8, req_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 , multi_level_queue:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , group_map:{group_id:18, queue_size:0, recv_req_cnt:329, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215741776438}{group_id:1, queue_size:0, recv_req_cnt:9, min_worker_cnt:8, max_worker_cnt:8, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215678655861}{group_id:20, queue_size:0, recv_req_cnt:122, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:0, nesting_worker_cnt:0, token_change:1745215691044075}{group_id:2, queue_size:0, recv_req_cnt:1358, min_worker_cnt:1, max_worker_cnt:150, multi_level_queue_:total_size=0 queue[0]=0 queue[1]=0 queue[2]=0 queue[3]=0 queue[4]=0 queue[5]=0 queue[6]=0 queue[7]=0 queue[8]=0 queue[9]=0 , recv_level_rpc_cnt:cnt[0]=0 cnt[1]=0 cnt[2]=0 cnt[3]=0 cnt[4]=0 cnt[5]=0 cnt[6]=0 cnt[7]=0 cnt[8]=0 cnt[9]=0 , worker_cnt:1, nesting_worker_cnt:0, token_change:1745215618113596}, rpc_stat_info: pcode=0x150b:cnt=40 pcode=0x150a:cnt=40 pcode=0x743:cnt=20, token_change_ts:1745215755970093, tenant_role:1}) [2025-04-21 14:09:49.092445] INFO [SERVER.OMT] print_throttled_time (ob_tenant.cpp:1679) [619729][MultiTenant][T0][Y0-0000000000000000-0-0] [lt=588] dump throttled time info(id_=1002, throttled_time_log=group_id: 18, group: OBCG_DBA_COMMAND, throttled_time: 0;group_id: 1, group: OBCG_CLOG, throttled_time: 0;group_id: 20, group: OBCG_LOCK, throttled_time: 0;group_id: 2, group: OBCG_ELECTION, throttled_time: 0;tenant_id: 1002, tenant_throttled_time: 0;) [2025-04-21 14:09:49.101859] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:49.101929] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:49.101985] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=67][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.110881] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:49.110935] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=50] start lib cache evict(tenant_id=1001, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:49.110956] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:49.110972] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:49.114129] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=47] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:49.114133] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=19] Dumping All Cache Objs(alloc_obj_list.count()=156, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}, {obj_id:457, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:49.114489] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=351] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:49.116010] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=15, avg_log_batch_cnt=1, total_group_log_size=9648, avg_group_log_size=643) [2025-04-21 14:09:49.116058] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND COST TIME](cur_stat_count=15, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:49.116169] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=58] get_max_applied_scn(scn={val:1745215789017845000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:66000543}, palf_committed_end_scn_:{val:1745215789017845000, v:0}, last_check_scn_:{val:1745215789017845000, v:0}, max_applied_cb_scn_:{val:1745215789017845000, v:0}}) [2025-04-21 14:09:49.116218] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:66000543}, readable_log_tail:{lsn:66000543}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1104225, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:49.117884] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9648) [2025-04-21 14:09:49.117966] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=14] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9648) [2025-04-21 14:09:49.118021] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=19, avg_log_submit_to_flush_time=4947, avg_log_submit_to_slide_time=4962) [2025-04-21 14:09:49.118090] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9648, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:49.118164] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=17] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215788915113000, v:0}, new_max_version={val:1745215788915113000, v:0}, last_min_version={val:1745215788714409000, v:0}, last_max_version={val:1745215788714409000, v:0}, total_time_us=3990, delta_us=203048) [2025-04-21 14:09:49.118208] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215788915113000, v:0}, min_version={val:1745215788915113000, v:0}, max_version={val:1745215788915113000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:49.121638] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:49.144989] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=90] PNIO [ratelimit] time: 1745215789144983, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007644, add_bytes: 0 [2025-04-21 14:09:49.145867] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=14, avg_log_submit_to_flush_time=3431, avg_log_submit_to_slide_time=3453) [2025-04-21 14:09:49.145967] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:49.146067] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:49.146114] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=3651, avg_log_submit_to_slide_time=3664) [2025-04-21 14:09:49.200697] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5958) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=29] tablet multi version start not advance for a long time(ret=0, ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000) [2025-04-21 14:09:49.200770] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=72] get multi version start(ls_id={id:1}, tablet_id={id:60379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.200850] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.200913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201022] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:50114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201169] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201236] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201507] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101011}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201646] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.201986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101098}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202056] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.202125] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=25] get multi version start(ls_id={id:1}, tablet_id={id:419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202215] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=33] get multi version start(ls_id={id:1}, tablet_id={id:60305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101036}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202549] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101064}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202694] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101080}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202765] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:50424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202832] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202898] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.202963] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203030] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203096] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101083}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203226] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203291] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203356] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203623] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203754] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203827] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.203995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=40] get multi version start(ls_id={id:1}, tablet_id={id:422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101084}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204393] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101068}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204458] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204526] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204790] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204855] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.204985] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205132] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205277] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101073}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205411] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205534] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:101099}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101092}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205734] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205876] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.205941] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206134] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206201] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206267] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.206937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101067}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:101005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207156] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101027}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207866] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.207931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101082}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208472] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208602] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208668] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208800] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101057}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.208996] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:50261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209145] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60381}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209211] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101033}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209403] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:60293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209591] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101066}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209655] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209720] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209846] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209911] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.209975] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210039] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210103] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101030}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101020}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210312] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101044}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210379] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210444] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210509] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210572] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210780] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210859] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:50146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.210994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211070] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211135] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101013}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211327] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:60294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211517] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101072}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211709] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211774] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101069}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211839] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211903] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.211968] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212033] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212160] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212225] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101060}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101100}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212417] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212482] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212546] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101022}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212803] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60515}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212931] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.212995] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=34] get multi version start(ls_id={id:1}, tablet_id={id:50471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213207] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:305}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213269] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213531] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:5}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101035}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213727] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213856] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213920] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101058}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.213983] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214049] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214114] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:245}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214181] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214246] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214311] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214375] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101019}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214506] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214570] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101079}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214707] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214776] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.214970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215045] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215113] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:1}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215241] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215369] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215434] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215497] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215560] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215624] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215880] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.215944] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216008] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216136] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216200] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216265] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216330] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216396] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216460] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216523] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216588] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216849] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.216978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50419}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217324] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217519] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217583] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217648] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217712] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50157}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217777] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.217970] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218038] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218102] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218167] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218232] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218297] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60150}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218360] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218423] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218488] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218551] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101043}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218615] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218680] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:167}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218896] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:149}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.218960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219284] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219350] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101032}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219544] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219607] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219671] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219735] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219863] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219928] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.219993] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220058] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220252] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220391] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220453] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=17] get multi version start(ls_id={id:1}, tablet_id={id:60236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220517] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50294}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220582] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101028}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220647] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220719] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50253}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220852] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.220981] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:60324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221128] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221257] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60292}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221321] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221385] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221576] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50111}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221706] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221771] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60110}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221835] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60528}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.221964] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222092] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101037}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:263}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222290] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222355] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101054}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50165}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222548] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222676] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101041}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222753] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=31] get multi version start(ls_id={id:1}, tablet_id={id:50369}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222819] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101097}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.222948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101024}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223013] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:236}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223143] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223271] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60225}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223461] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60423}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223527] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223593] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101055}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223660] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50496}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:113}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223791] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223857] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223923] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.223921] INFO [COMMON] generate_mod_stat_task (memory_dump.cpp:218) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=16] task info(*task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:49.223988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224002] INFO [COMMON] handle (memory_dump.cpp:550) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=78] handle dump task(task={type_:2, dump_all_:false, p_context_:null, slot_idx_:0, dump_tenant_ctx_:false, tenant_id_:0, ctx_id_:0, p_chunk_:null}) [2025-04-21 14:09:49.224055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:471}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224381] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224446] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:3}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224516] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224581] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224647] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224713] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101040}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224778] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224844] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224825] INFO [COMMON] update_check_range (ob_sql_mem_leak_checker.cpp:62) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=34] update_check_range(min_check_version=17, max_check_version=18, global_version=19) [2025-04-21 14:09:49.224910] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50494}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.224978] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:248}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101047}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225195] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60307}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225325] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225537] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225672] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225750] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225817] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225883] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:441}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.225949] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226014] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:470}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226209] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226339] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226470] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:380}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226742] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226809] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226874] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50166}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.226940] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227006] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227073] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60143}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227336] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60406}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227405] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227538] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227603] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101046}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227731] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50464}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227795] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60252}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227925] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.227989] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228055] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228121] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228186] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228316] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228447] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228600] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101045}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228667] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228733] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228798] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228865] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:131}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228929] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.228994] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229078] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=35] get multi version start(ls_id={id:1}, tablet_id={id:50243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60316}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229276] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:246}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229342] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101078}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101049}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229804] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229869] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.229934] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230066] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101101}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230197] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50255}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230263] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230329] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230465] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:514}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230595] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230661] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101091}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230736] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=28] get multi version start(ls_id={id:1}, tablet_id={id:50426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230814] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.230947] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:356}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231014] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101029}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231079] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231144] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231210] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60408}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231275] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231340] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231406] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231471] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231535] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50397}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231601] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231666] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231732] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:333}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.231991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:424}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232185] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50422}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232382] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101070}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232513] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232579] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232645] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232711] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101075}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232775] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50182}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232841] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232907] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.232973] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233061] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101077}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233129] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233194] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233261] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101071}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101012}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:420}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233520] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50220}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233584] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101065}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233650] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:438}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50495}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233782] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:214}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:329}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.233979] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:100003}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234178] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234243] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50435}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234309] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101014}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234440] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234505] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:334}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234571] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234631] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=16] get multi version start(ls_id={id:1}, tablet_id={id:50506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234705] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:261}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234773] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:147}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234840] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234905] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50103}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.234971] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101004}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235101] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235235] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60319}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235499] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60467}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235635] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235700] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235766] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:413}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235830] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235895] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:240}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.235960] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50503}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236025] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50213}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236089] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60463}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:133}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236220] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101050}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50407}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236349] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100001}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236413] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50284}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236479] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:243}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60498}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236611] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50327}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236677] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60436}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60223}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101056}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50210}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.236937] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:180}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237168] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237234] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60207}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237301] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101023}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237366] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:146}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237431] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101007}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237564] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237630] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101026}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237702] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237768] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237834] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60189}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237900] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.237965] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50215}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238029] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238093] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:513}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238159] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238224] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238288] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238354] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238420] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60188}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238485] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238616] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238679] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:104}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=30] get multi version start(ls_id={id:1}, tablet_id={id:4}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238821] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100005}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238884] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.238950] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239015] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60120}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239081] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60377}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239147] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60512}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239213] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239278] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239343] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50259}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239474] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239540] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50254}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239605] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239673] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:101085}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239737] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60209}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239802] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50518}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239867] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:466}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239932] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.239997] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240062] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:306}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60443}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240191] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:132}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240256] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101087}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240338] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50153}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240408] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60490}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240476] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:336}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240542] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50233}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240608] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50427}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240674] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240741] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50191}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240807] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:343}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240872] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60232}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.240938] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241017] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:100006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:60382}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241154] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60396}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101061}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241351] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60202}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50181}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241545] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241610] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101076}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241675] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241739] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:121}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241805] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241870] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101006}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.241935] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60272}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242000] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242065] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50283}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242262] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:425}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242390] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60221}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242456] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242522] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101074}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:469}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60192}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:50323}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:101053}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60482}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242926] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:211}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.242991] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243056] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50105}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243122] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50237}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243187] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60142}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243253] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243319] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243384] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243448] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243512] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50468}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243586] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=27] get multi version start(ls_id={id:1}, tablet_id={id:50112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:491}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60474}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243784] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50405}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243851] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60152}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60291}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.243986] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:60428}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244072] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=37] get multi version start(ls_id={id:1}, tablet_id={id:50102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244138] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:505}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244203] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60102}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:431}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244333] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60295}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244397] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244463] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60241}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50297}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:437}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244659] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244724] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60434}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101042}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244919] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.244984] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245063] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:50224}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245133] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=24] get multi version start(ls_id={id:1}, tablet_id={id:60497}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245199] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245266] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245332] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50293}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245467] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:101096}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245533] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60247}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245598] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50465}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245665] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1}, tablet_id={id:352}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245726] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=15] get multi version start(ls_id={id:1}, tablet_id={id:242}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245792] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50499}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245858] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:440}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245922] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1}, tablet_id={id:50197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.245988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50148}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246053] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:50421}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246120] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60222}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246184] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60290}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246250] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101038}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246315] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:60506}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246380] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50519}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246443] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60260}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246508] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:50169}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246574] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60238}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246640] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:101090}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1}, tablet_id={id:60328}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246785] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1}, tablet_id={id:442}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.246853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1}, tablet_id={id:373}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247054] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200589}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247127] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=27] get multi version start(ls_id={id:1001}, tablet_id={id:200426}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247193] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200876}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247258] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200048}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247323] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201365}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247388] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200929}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247454] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200529}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201384}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200608}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247653] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200450}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247718] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200197}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247783] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200127}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247848] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200810}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247913] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200251}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.247977] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201051}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248043] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200767}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248107] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200999}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201394}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248239] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201235}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248303] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201250}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248367] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200822}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248432] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201318}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201309}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248562] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200325}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248628] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201025}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248692] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200874}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248756] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200971}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248822] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200880}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248887] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201270}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.248951] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200347}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249036] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201081}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249105] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249172] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201151}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249238] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200124}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249302] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201126}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249368] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200976}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249433] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200913}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249498] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200566}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249563] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201351}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249629] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200312}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249695] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201205}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249763] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200690}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249828] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201335}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249893] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200193}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.249958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200911}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250023] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200107}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250088] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201239}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250153] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200301}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250219] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200703}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250285] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200379}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250299] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:49.250353] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:201375}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250415] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=16] get multi version start(ls_id={id:1001}, tablet_id={id:200808}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250481] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200130}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250550] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200052}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=16] get multi version start(ls_id={id:1001}, tablet_id={id:201138}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250688] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200063}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250758] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200707}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250825] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200031}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250892] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200314}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.250958] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200662}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251021] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201093}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251087] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200492}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251155] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200893}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251221] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200275}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251287] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200725}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251352] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201135}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251418] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200678}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251483] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200332}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251547] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201114}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251612] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200300}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251678] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200304}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251743] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201095}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251808] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200355}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251873] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200739}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.251939] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846997}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252005] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200206}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252071] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200799}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252137] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200691}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252202] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200410}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252268] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201289}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252334] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201331}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252398] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201039}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252462] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201088}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252528] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201402}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252594] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200433}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252658] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201196}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252723] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200867}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252789] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200732}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200706}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252918] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200480}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.252982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200364}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253064] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=32] get multi version start(ls_id={id:1001}, tablet_id={id:200746}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253131] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201208}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253196] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200264}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253260] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201324}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253326] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200271}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253392] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201350}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253457] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253521] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201112}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253587] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200764}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253652] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253716] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200533}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253781] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200747}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253847] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200163}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253914] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200183}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.253980] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200500}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254046] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606847002}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201244}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201366}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200136}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254306] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200950}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254372] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201398}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254437] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200109}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254501] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201115}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254566] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201190}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254633] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200731}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254708] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200997}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254788] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=31] get multi version start(ls_id={id:1001}, tablet_id={id:200914}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254853] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200882}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254916] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200310}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.254982] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200504}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255048] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200700}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255112] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200330}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255177] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201086}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255242] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201106}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255308] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200448}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255374] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200400}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255439] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201429}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255503] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200391}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255569] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200994}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255637] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200059}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255704] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:200918}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255769] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200178}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255833] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255902] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=23] get multi version start(ls_id={id:1001}, tablet_id={id:200951}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.255967] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200387}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256032] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200995}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256097] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201414}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256162] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200034}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256228] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200664}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256292] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200534}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256358] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200199}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256422] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200677}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256489] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201262}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256553] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201326}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256618] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200122}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256683] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201194}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256749] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200579}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256816] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200493}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256882] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201145}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.256948] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200184}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257027] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201278}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257098] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=22] get multi version start(ls_id={id:1001}, tablet_id={id:201258}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257105] INFO handle (memory_dump.cpp:677) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=40] statistics: tenant_cnt: 6, max_chunk_cnt: 524288 tenant_id ctx_id chunk_cnt label_cnt segv_cnt 1 0 165 249 0 1 2 87 1 0 1 4 1 1 0 1 5 44 4 0 1 7 1 2 0 1 8 58 1 0 1 12 3 2 0 1 13 7 1 0 1 14 1 1 0 1 15 1 1 0 1 18 3 3 0 1 20 1 1 0 500 0 93 233 0 500 7 8 4 0 500 8 52 1 0 500 9 2 1 0 500 10 2 1 0 500 16 2 1 0 500 17 6 7 0 500 22 51 62 0 500 23 22 10 0 508 0 4 8 0 508 8 15 1 0 509 0 3 8 0 509 8 9 1 0 1001 0 89 223 0 1001 2 33 1 0 1001 4 1 1 0 1001 5 22 4 0 1001 8 34 1 0 1001 12 2 2 0 1001 13 1 1 0 1001 14 1 1 0 1001 18 3 3 0 1001 20 1 2 0 1002 0 98 246 0 1002 2 33 1 0 1002 4 1 1 0 1002 5 21 4 0 1002 8 38 1 0 1002 12 5 3 0 1002 13 2 1 0 1002 14 1 1 0 1002 18 5 3 0 1002 20 1 2 0 cost_time: 32331 [2025-04-21 14:09:49.257165] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200946}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257191] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=45] [MEMORY] tenant: 1, limit: 5,368,709,120 hold: 1,079,066,624 rpc_hold: 0 cache_hold: 134,217,728 cache_used: 134,217,728 cache_item_count: 64 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 462,483,456 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MEMSTORE_CTX_ID hold_bytes= 182,452,224 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TRANS_CTX_MGR_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PLAN_CACHE_CTX_ID hold_bytes= 92,274,688 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 121,634,816 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= META_OBJ_CTX_ID hold_bytes= 6,291,456 limit= 1,073,741,820 [MEMORY] ctx_id= TX_CALLBACK_CTX_ID hold_bytes= 14,680,064 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOB_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PS_CACHE_CTX_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= TX_DATA_TABLE hold_bytes= 20,992,000 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MDS_DATA_ID hold_bytes= 2,097,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= MERGE_RESERVE_CTX_ID hold_bytes= 33,554,432 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:49.257230] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200168}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257295] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201308}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257359] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200755}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257425] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201388}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257491] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846983}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257555] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:1152921504606846990}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257621] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200975}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257685] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200798}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257751] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200270}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257815] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200967}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257831] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=35] [MEMORY] tenant_id= 1 ctx_id= DEFAULT_CTX_ID hold= 462,483,456 used= 384,460,544 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 29 [MEMORY] hold= 93,184,000 used= 93,003,328 count= 56 avg_used= 1,660,773 block_cnt= 56 chunk_cnt= 47 mod=MysqlRequesReco [MEMORY] hold= 41,963,520 used= 41,943,040 count= 1 avg_used= 41,943,040 block_cnt= 1 chunk_cnt= 1 mod=LogGroupBuffer [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 6 mod=IoControl [MEMORY] hold= 20,807,680 used= 20,797,440 count= 10 avg_used= 2,079,744 block_cnt= 10 chunk_cnt= 10 mod=CACHE_MAP_NODE [MEMORY] hold= 17,039,360 used= 15,478,528 count= 208 avg_used= 74,416 block_cnt= 208 chunk_cnt= 30 mod=[T]ObSessionDIB [MEMORY] hold= 15,152,720 used= 14,983,929 count= 109 avg_used= 137,467 block_cnt= 38 chunk_cnt= 8 mod=OmtTenant [MEMORY] hold= 9,859,072 used= 9,831,040 count= 2 avg_used= 4,915,520 block_cnt= 2 chunk_cnt= 2 mod=HashBuckDmId [MEMORY] hold= 9,625,600 used= 9,584,640 count= 2 avg_used= 4,792,320 block_cnt= 2 chunk_cnt= 2 mod=ServerObjecPool [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDmChe [MEMORY] hold= 8,777,728 used= 8,760,064 count= 2 avg_used= 4,380,032 block_cnt= 2 chunk_cnt= 2 mod=FreeTbltStream [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=RCSrv [MEMORY] hold= 8,540,160 used= 8,519,680 count= 1 avg_used= 8,519,680 block_cnt= 1 chunk_cnt= 1 mod=ArcFetchQueue [MEMORY] hold= 4,792,320 used= 4,210,688 count= 71 avg_used= 59,305 block_cnt= 71 chunk_cnt= 13 mod=[T]char [MEMORY] hold= 4,739,072 used= 4,718,712 count= 1 avg_used= 4,718,712 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMonMap [MEMORY] hold= 4,571,136 used= 4,525,056 count= 6 avg_used= 754,176 block_cnt= 6 chunk_cnt= 5 mod=ResourceGroup [MEMORY] hold= 4,235,264 used= 4,194,304 count= 2 avg_used= 2,097,152 block_cnt= 2 chunk_cnt= 2 mod=SHARE_BLOCK [MEMORY] hold= 4,214,784 used= 4,194,336 count= 1 avg_used= 4,194,336 block_cnt= 1 chunk_cnt= 1 mod=BloomFilter [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMemCU [MEMORY] hold= 3,865,600 used= 3,705,600 count= 800 avg_used= 4,632 block_cnt= 800 chunk_cnt= 15 mod=CkptDgnMem [MEMORY] hold= 3,772,416 used= 3,751,944 count= 1 avg_used= 3,751,944 block_cnt= 1 chunk_cnt= 1 mod=IteratorStorage [MEMORY] hold= 3,757,824 used= 3,723,528 count= 74 avg_used= 50,317 block_cnt= 74 chunk_cnt= 4 mod=TabletMap [MEMORY] hold= 3,723,264 used= 3,698,704 count= 2 avg_used= 1,849,352 block_cnt= 2 chunk_cnt= 2 mod=LogDIOAligned [MEMORY] hold= 3,218,112 used= 3,084,912 count= 666 avg_used= 4,632 block_cnt= 666 chunk_cnt= 19 mod=WorkerMap [MEMORY] hold= 3,162,112 used= 3,145,808 count= 2 avg_used= 1,572,904 block_cnt= 2 chunk_cnt= 2 mod=TenantDLMgr [MEMORY] hold= 3,145,728 used= 2,228,224 count= 128 avg_used= 17,408 block_cnt= 128 chunk_cnt= 5 mod=SqlDtlQueue [MEMORY] hold= 2,949,120 used= 2,931,968 count= 1 avg_used= 2,931,968 block_cnt= 1 chunk_cnt= 1 mod=RpcStatInfo [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=HashBuckDTLINT [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=MediumTabletMap [MEMORY] hold= 2,379,776 used= 2,359,608 count= 1 avg_used= 2,359,608 block_cnt= 1 chunk_cnt= 1 mod=FastFrezCkr [MEMORY] hold= 2,375,680 used= 2,359,536 count= 2 avg_used= 1,179,768 block_cnt= 2 chunk_cnt= 2 mod=HashBuckLCSta [MEMORY] hold= 2,248,704 used= 2,228,224 count= 1 avg_used= 2,228,224 block_cnt= 1 chunk_cnt= 1 mod=LogIOCb [MEMORY] hold= 2,198,928 used= 416,700 count= 25,277 avg_used= 16 block_cnt= 270 chunk_cnt= 2 mod=Number [MEMORY] hold= 2,150,400 used= 2,131,072 count= 1 avg_used= 2,131,072 block_cnt= 1 chunk_cnt= 1 mod=TransService [MEMORY] hold= 2,097,152 used= 2,095,616 count= 2 avg_used= 1,047,808 block_cnt= 2 chunk_cnt= 2 mod=TmpFileWBP [MEMORY] hold= 1,843,200 used= 1,770,696 count= 9 avg_used= 196,744 block_cnt= 9 chunk_cnt= 4 mod=DagMap [MEMORY] hold= 1,603,840 used= 1,517,936 count= 42 avg_used= 36,141 block_cnt= 42 chunk_cnt= 11 mod=CommSysVarFac [MEMORY] hold= 1,584,544 used= 1,575,992 count= 3 avg_used= 525,330 block_cnt= 2 chunk_cnt= 2 mod=PartitTableTask [MEMORY] hold= 1,523,712 used= 1,506,734 count= 5 avg_used= 301,346 block_cnt= 5 chunk_cnt= 1 mod=LDIOSetup [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=XATimeWheel [MEMORY] hold= 1,294,336 used= 1,280,384 count= 2 avg_used= 640,192 block_cnt= 2 chunk_cnt= 1 mod=TransTimeWheel [MEMORY] hold= 1,269,568 used= 1,263,904 count= 6 avg_used= 210,650 block_cnt= 6 chunk_cnt= 3 mod=PoolFreeList [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsCache [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPsInfo [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=HashBuckPlanCac [MEMORY] hold= 1,187,840 used= 1,179,768 count= 1 avg_used= 1,179,768 block_cnt= 1 chunk_cnt= 1 mod=RewriteRuleMap [MEMORY] hold= 1,138,688 used= 1,133,056 count= 1 avg_used= 1,133,056 block_cnt= 1 chunk_cnt= 1 mod=RespTimeColl [MEMORY] hold= 1,032,192 used= 1,014,944 count= 7 avg_used= 144,992 block_cnt= 7 chunk_cnt= 6 mod=SQLSessionInfo [MEMORY] hold= 958,464 used= 950,272 count= 1 avg_used= 950,272 block_cnt= 1 chunk_cnt= 1 mod=IOWorkerLQ [MEMORY] hold= 933,888 used= 931,072 count= 1 avg_used= 931,072 block_cnt= 1 chunk_cnt= 1 mod=ArcSenderQueue [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlPlanMon [MEMORY] hold= 802,816 used= 800,000 count= 1 avg_used= 800,000 block_cnt= 1 chunk_cnt= 1 mod=SqlFltSpanRec [MEMORY] hold= 786,688 used= 524,352 count= 33 avg_used= 15,889 block_cnt= 33 chunk_cnt= 3 mod=LogAlloc [MEMORY] hold= 704,512 used= 346,064 count= 43 avg_used= 8,048 block_cnt= 43 chunk_cnt= 14 mod=[T]ObPerfEventR [MEMORY] hold= 663,552 used= 659,200 count= 1 avg_used= 659,200 block_cnt= 1 chunk_cnt= 1 mod=MulLevelQueue [MEMORY] hold= 663,552 used= 655,360 count= 1 avg_used= 655,360 block_cnt= 1 chunk_cnt= 1 mod=FetchLog [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=ElectTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MultiVersionGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=FrzTrigger [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DetectorTimer [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTF [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=CoordTR [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=OBJLockGC [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=DupTbLease [MEMORY] hold= 647,168 used= 640,192 count= 1 avg_used= 640,192 block_cnt= 1 chunk_cnt= 1 mod=MdsT [MEMORY] hold= 609,600 used= 595,200 count= 75 avg_used= 7,936 block_cnt= 75 chunk_cnt= 14 mod=ParamCharsType [MEMORY] hold= 598,016 used= 590,232 count= 1 avg_used= 590,232 block_cnt= 1 chunk_cnt= 1 mod=DagNetIdMap [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ReplaySrv [MEMORY] hold= 409,600 used= 401,408 count= 1 avg_used= 401,408 block_cnt= 1 chunk_cnt= 1 mod=ApplySrv [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=T3MBucket [MEMORY] hold= 401,408 used= 393,504 count= 1 avg_used= 393,504 block_cnt= 1 chunk_cnt= 1 mod=ClogGe [MEMORY] hold= 401,408 used= 393,248 count= 1 avg_used= 393,248 block_cnt= 1 chunk_cnt= 1 mod=ResourMapLock [MEMORY] hold= 393,088 used= 377,152 count= 83 avg_used= 4,544 block_cnt= 83 chunk_cnt= 21 mod=[T]ObTraceEvent [MEMORY] hold= 385,024 used= 375,520 count= 2 avg_used= 187,760 block_cnt= 2 chunk_cnt= 1 mod=bf_queue [MEMORY] hold= 338,112 used= 280,576 count= 258 avg_used= 1,087 block_cnt= 45 chunk_cnt= 3 mod=LSMap [MEMORY] hold= 311,296 used= 262,144 count= 256 avg_used= 1,024 block_cnt= 43 chunk_cnt= 2 mod=TabletToLS [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=DmlStatHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=ColUsagHashMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompStMap [MEMORY] hold= 303,104 used= 294,936 count= 1 avg_used= 294,936 block_cnt= 1 chunk_cnt= 1 mod=RSCompactMap [MEMORY] hold= 262,144 used= 261,120 count= 4 avg_used= 65,280 block_cnt= 4 chunk_cnt= 3 mod=MemTblObj [MEMORY] hold= 227,584 used= 222,208 count= 28 avg_used= 7,936 block_cnt= 28 chunk_cnt= 9 mod=SqlSession [MEMORY] hold= 212,992 used= 212,736 count= 1 avg_used= 212,736 block_cnt= 1 chunk_cnt= 1 mod=MetaMemMgr [MEMORY] hold= 204,800 used= 196,616 count= 1 avg_used= 196,616 block_cnt= 1 chunk_cnt= 1 mod=TenDLBucket [MEMORY] hold= 204,800 used= 196,744 count= 1 avg_used= 196,744 block_cnt= 1 chunk_cnt= 1 mod=DagNetMap [MEMORY] hold= 163,840 used= 92,240 count= 10 avg_used= 9,224 block_cnt= 10 chunk_cnt= 7 mod=[T]ObDSActionAr [MEMORY] hold= 154,944 used= 2,177 count= 1,920 avg_used= 1 block_cnt= 20 chunk_cnt= 1 mod=CharsetUtil [MEMORY] hold= 152,192 used= 115,200 count= 26 avg_used= 4,430 block_cnt= 18 chunk_cnt= 11 mod=TGTimer [MEMORY] hold= 147,456 used= 139,264 count= 1 avg_used= 139,264 block_cnt= 1 chunk_cnt= 1 mod=RFLTaskQueue [MEMORY] hold= 122,880 used= 110,608 count= 2 avg_used= 55,304 block_cnt= 2 chunk_cnt= 2 mod=TabletIDSetBkt [MEMORY] hold= 122,688 used= 118,904 count= 2 avg_used= 59,452 block_cnt= 2 chunk_cnt= 2 mod=DbmsSched_Job [MEMORY] hold= 114,688 used= 106,496 count= 1 avg_used= 106,496 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlMgr [MEMORY] hold= 114,688 used= 111,096 count= 1 avg_used= 111,096 block_cnt= 1 chunk_cnt= 1 mod=AsyncFreezeTabl [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=SqlSessiVarMap [MEMORY] hold= 113,792 used= 111,104 count= 14 avg_used= 7,936 block_cnt= 14 chunk_cnt= 9 mod=PlanVaIdx [MEMORY] hold= 110,672 used= 29,056 count= 400 avg_used= 72 block_cnt= 162 chunk_cnt= 29 mod=Coro [MEMORY] hold= 98,304 used= 91,968 count= 1 avg_used= 91,968 block_cnt= 1 chunk_cnt= 1 mod=tenant_mf_mgr [MEMORY] hold= 90,112 used= 87,264 count= 1 avg_used= 87,264 block_cnt= 1 chunk_cnt= 1 mod=LSSvr [MEMORY] hold= 80,000 used= 78,080 count= 10 avg_used= 7,808 block_cnt= 10 chunk_cnt= 3 mod=TabletIDSetNode [MEMORY] hold= 77,824 used= 65,536 count= 64 avg_used= 1,024 block_cnt= 13 chunk_cnt= 3 mod=TxCtxMgr [MEMORY] hold= 73,728 used= 66,176 count= 1 avg_used= 66,176 block_cnt= 1 chunk_cnt= 1 mod=Rpc [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSubmitLogQue [MEMORY] hold= 73,728 used= 72,736 count= 1 avg_used= 72,736 block_cnt= 1 chunk_cnt= 1 mod=LogSharedQueueT [MEMORY] hold= 73,152 used= 71,424 count= 9 avg_used= 7,936 block_cnt= 9 chunk_cnt= 6 mod=TltMemtablMgr [MEMORY] hold= 66,752 used= 66,304 count= 2 avg_used= 33,152 block_cnt= 2 chunk_cnt= 1 mod=DEVICE_MANAGER [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushMeta [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=FlushLog [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxCtxMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=TxDataMemObj [MEMORY] hold= 65,536 used= 65,280 count= 1 avg_used= 65,280 block_cnt= 1 chunk_cnt= 1 mod=LockMemObj [MEMORY] hold= 65,024 used= 63,488 count= 8 avg_used= 7,936 block_cnt= 8 chunk_cnt= 7 mod=QueryAllocator [MEMORY] hold= 64,000 used= 62,464 count= 8 avg_used= 7,808 block_cnt= 8 chunk_cnt= 4 mod=HashNodeLCSta [MEMORY] hold= 57,344 used= 50,816 count= 1 avg_used= 50,816 block_cnt= 1 chunk_cnt= 1 mod=palf_env [MEMORY] hold= 57,088 used= 52,776 count= 3 avg_used= 17,592 block_cnt= 3 chunk_cnt= 3 mod=HB_SERVICE [MEMORY] hold= 48,960 used= 44,840 count= 2 avg_used= 22,420 block_cnt= 2 chunk_cnt= 2 mod=DynamicFactor [MEMORY] hold= 46,992 used= 4,992 count= 208 avg_used= 24 block_cnt= 121 chunk_cnt= 26 mod=[T]MemoryContex [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HashBucCliInFo [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=TableAQueryBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=DagWarnHisBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletPtrMap [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=SuspectInfoBkt [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=Autoincrement [MEMORY] hold= 40,960 used= 37,032 count= 1 avg_used= 37,032 block_cnt= 1 chunk_cnt= 1 mod=HTblRkMapBkt [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=ObDMMDL [MEMORY] hold= 40,640 used= 39,680 count= 5 avg_used= 7,936 block_cnt= 5 chunk_cnt= 1 mod=NotParamInfo [MEMORY] hold= 40,608 used= 31,584 count= 47 avg_used= 672 block_cnt= 46 chunk_cnt= 17 mod=[T]ObWarningBuf [MEMORY] hold= 36,480 used= 34,560 count= 10 avg_used= 3,456 block_cnt= 8 chunk_cnt= 7 mod=CACHE_INST [MEMORY] hold= 33,920 used= 23,744 count= 53 avg_used= 448 block_cnt= 29 chunk_cnt= 9 mod=OMT_Worker [MEMORY] hold= 32,768 used= 31,616 count= 1 avg_used= 31,616 block_cnt= 1 chunk_cnt= 1 mod=IO_MGR [MEMORY] hold= 32,768 used= 24,688 count= 2 avg_used= 12,344 block_cnt= 2 chunk_cnt= 2 mod=TLD_AssignedMgr [MEMORY] hold= 32,768 used= 31,744 count= 1 avg_used= 31,744 block_cnt= 1 chunk_cnt= 1 mod=ArrayIdxArr [MEMORY] hold= 32,704 used= 25,191 count= 2 avg_used= 12,595 block_cnt= 2 chunk_cnt= 2 mod=CGReadInfoMgr [MEMORY] hold= 32,000 used= 31,232 count= 4 avg_used= 7,808 block_cnt= 4 chunk_cnt= 3 mod=HashNodePlanCac [MEMORY] hold= 31,936 used= 31,168 count= 4 avg_used= 7,792 block_cnt= 4 chunk_cnt= 4 mod=ColUsagNode [MEMORY] hold= 24,576 used= 16,392 count= 1 avg_used= 16,392 block_cnt= 1 chunk_cnt= 1 mod=SlogWriteBuffer [MEMORY] hold= 24,336 used= 20,104 count= 2 avg_used= 10,052 block_cnt= 2 chunk_cnt= 2 mod=TLD_ResourceMgr [MEMORY] hold= 17,024 used= 8,448 count= 3 avg_used= 2,816 block_cnt= 2 chunk_cnt= 1 mod=BaseLogWriter [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=MedCheckSet [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TabletStats [MEMORY] hold= 16,384 used= 8,200 count= 1 avg_used= 8,200 block_cnt= 1 chunk_cnt= 1 mod=SlogNopLog [MEMORY] hold= 16,384 used= 9,792 count= 1 avg_used= 9,792 block_cnt= 1 chunk_cnt= 1 mod=TSQLSessionMgr [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=DiaTabletMap [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=backupTaskSched [MEMORY] hold= 16,384 used= 13,888 count= 1 avg_used= 13,888 block_cnt= 1 chunk_cnt= 1 mod=LogReplayStatus [MEMORY] hold= 16,384 used= 10,248 count= 1 avg_used= 10,248 block_cnt= 1 chunk_cnt= 1 mod=TabletSvrBucket [MEMORY] hold= 16,384 used= 11,584 count= 1 avg_used= 11,584 block_cnt= 1 chunk_cnt= 1 mod=LogApplyStatus [MEMORY] hold= 16,384 used= 13,896 count= 1 avg_used= 13,896 block_cnt= 1 chunk_cnt= 1 mod=task_cache [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_ClientTask [MEMORY] hold= 16,384 used= 12,344 count= 1 avg_used= 12,344 block_cnt= 1 chunk_cnt= 1 mod=TLD_TableCtxMgr [MEMORY] hold= 16,384 used= 8,448 count= 1 avg_used= 8,448 block_cnt= 1 chunk_cnt= 1 mod=PalfEnv [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapDi [MEMORY] hold= 12,864 used= 12,288 count= 3 avg_used= 4,096 block_cnt= 3 chunk_cnt= 3 mod=LinearHashMapCn [MEMORY] hold= 11,984 used= 11,592 count= 2 avg_used= 5,796 block_cnt= 2 chunk_cnt= 2 mod=StopWordSet [MEMORY] hold= 10,112 used= 7,395 count= 14 avg_used= 528 block_cnt= 13 chunk_cnt= 8 mod=SqlSessiQuerSql [MEMORY] hold= 9,712 used= 9,312 count= 2 avg_used= 4,656 block_cnt= 2 chunk_cnt= 2 mod=HashBucPsSessIn [MEMORY] hold= 9,456 used= 9,064 count= 2 avg_used= 4,532 block_cnt= 2 chunk_cnt= 2 mod=GROUP_INDEX_MAP [MEMORY] hold= 9,376 used= 8,984 count= 2 avg_used= 4,492 block_cnt= 2 chunk_cnt= 2 mod=FTPluginMap [MEMORY] hold= 8,768 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 9 mod=ContextsMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 14 chunk_cnt= 8 mod=PackStateMap [MEMORY] hold= 8,736 used= 5,936 count= 14 avg_used= 424 block_cnt= 13 chunk_cnt= 9 mod=SequenceIdMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileBlkMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TmpFileMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LockWaitMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=IORunners [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LCLSender [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FTPluginHandle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ls_id [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=leakChecker [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsTableMgr [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MdsDebugMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DbmsScheduler [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LsElectRefInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=ShareBlksMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LinearHashMapNo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=DASIDCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LSInfo [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=PurgeThrottle [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=REPLAY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=APPLY_STATUS [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=FillCache [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=HTableLockMap [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=MatchLsnMap [MEMORY] hold= 8,096 used= 7,904 count= 1 avg_used= 7,904 block_cnt= 1 chunk_cnt= 1 mod=PsSessionInfo [MEMORY] hold= 8,000 used= 7,808 count= 1 avg_used= 7,808 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsInfo [MEMORY] hold= 7,920 used= 7,728 count= 1 avg_used= 7,728 block_cnt= 1 chunk_cnt= 1 mod=HashNodePsCache [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=DmlStatNode [MEMORY] hold= 7,904 used= 7,712 count= 1 avg_used= 7,712 block_cnt= 1 chunk_cnt= 1 mod=HasNodGrpInfo [MEMORY] hold= 7,824 used= 7,632 count= 1 avg_used= 7,632 block_cnt= 1 chunk_cnt= 1 mod=CaLsInfoNode [MEMORY] hold= 7,376 used= 7,184 count= 1 avg_used= 7,184 block_cnt= 1 chunk_cnt= 1 mod=mrg_prog_cker [MEMORY] hold= 5,056 used= 4,656 count= 2 avg_used= 2,328 block_cnt= 2 chunk_cnt= 2 mod=CaLsInfoMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=PxPoolBkt [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ExTabletCntMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResRuleIdMap [MEMORY] hold= 4,832 used= 4,632 count= 1 avg_used= 4,632 block_cnt= 1 chunk_cnt= 1 mod=ResGrpIdMap [MEMORY] hold= 4,288 used= 4,096 count= 1 avg_used= 4,096 block_cnt= 1 chunk_cnt= 1 mod=MacroFile [MEMORY] hold= 3,328 used= 1,792 count= 8 avg_used= 224 block_cnt= 5 chunk_cnt= 2 mod=LogIOTask [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=TFileFLCtx [MEMORY] hold= 3,312 used= 3,112 count= 1 avg_used= 3,112 block_cnt= 1 chunk_cnt= 1 mod=PendingFreeMap [MEMORY] hold= 3,200 used= 3,008 count= 1 avg_used= 3,008 block_cnt= 1 chunk_cnt= 1 mod=SqlDtlDfc [MEMORY] hold= 2,880 used= 1,920 count= 5 avg_used= 384 block_cnt= 4 chunk_cnt= 3 mod=TableLockNode [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MvRefreshInfo [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=IRMMemHashBuck [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=MedCheckMap [MEMORY] hold= 2,528 used= 2,328 count= 1 avg_used= 2,328 block_cnt= 1 chunk_cnt= 1 mod=VecIdxLSMgr [MEMORY] hold= 2,048 used= 1,856 count= 1 avg_used= 1,856 block_cnt= 1 chunk_cnt= 1 mod=LogIOWS [MEMORY] hold= 2,000 used= 1,800 count= 1 avg_used= 1,800 block_cnt= 1 chunk_cnt= 1 mod=PxResMgr [MEMORY] hold= 1,744 used= 1,352 count= 2 avg_used= 676 block_cnt= 2 chunk_cnt= 2 mod=DetectManager [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TabStatMgrLock [MEMORY] hold= 1,744 used= 1,544 count= 1 avg_used= 1,544 block_cnt= 1 chunk_cnt= 1 mod=TXBFRetryId [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucGrpInfo [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=HashBucApiGroup [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=GCMemtableMap [MEMORY] hold= 1,472 used= 1,272 count= 1 avg_used= 1,272 block_cnt= 1 chunk_cnt= 1 mod=DUP_LS_SET [MEMORY] hold= 1,344 used= 960 count= 2 avg_used= 480 block_cnt= 1 chunk_cnt= 1 mod=PoolArenaArray [MEMORY] hold= 1,280 used= 1,088 count= 1 avg_used= 1,088 block_cnt= 1 chunk_cnt= 1 mod=ModuleInitCtx [MEMORY] hold= 1,248 used= 1,056 count= 1 avg_used= 1,056 block_cnt= 1 chunk_cnt= 1 mod=LOG_HASH_MAP [MEMORY] hold= 1,216 used= 1,024 count= 1 avg_used= 1,024 block_cnt= 1 chunk_cnt= 1 mod=LockMemtableMgr [MEMORY] hold= 1,200 used= 1,000 count= 1 avg_used= 1,000 block_cnt= 1 chunk_cnt= 1 mod=FlyTabletMapLk [MEMORY] hold= 1,152 used= 960 count= 1 avg_used= 960 block_cnt= 1 chunk_cnt= 1 mod=FTParserMgr [MEMORY] hold= 1,120 used= 120 count= 5 avg_used= 24 block_cnt= 2 chunk_cnt= 1 mod=FreezeTask [MEMORY] hold= 976 used= 776 count= 1 avg_used= 776 block_cnt= 1 chunk_cnt= 1 mod=DepTabletSet [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=FlushTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=DiskUsageTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=CheckPointTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TabShellTimer [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=tenant_rm_mgr [MEMORY] hold= 960 used= 768 count= 1 avg_used= 768 block_cnt= 1 chunk_cnt= 1 mod=TLD_TIMER [MEMORY] hold= 848 used= 648 count= 1 avg_used= 648 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfo [MEMORY] hold= 752 used= 552 count= 1 avg_used= 552 block_cnt= 1 chunk_cnt= 1 mod=LSFreeze [MEMORY] hold= 672 used= 288 count= 2 avg_used= 144 block_cnt= 2 chunk_cnt= 2 mod=ObTxLSLogCb [MEMORY] hold= 672 used= 472 count= 1 avg_used= 472 block_cnt= 1 chunk_cnt= 1 mod=Election [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=VectorIndexVsag [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=Scheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=HAScheduler [MEMORY] hold= 576 used= 384 count= 1 avg_used= 384 block_cnt= 1 chunk_cnt= 1 mod=MSTXCTX [MEMORY] hold= 544 used= 144 count= 2 avg_used= 72 block_cnt= 1 chunk_cnt= 1 mod=TntSrvObjPool [MEMORY] hold= 512 used= 120 count= 2 avg_used= 60 block_cnt= 2 chunk_cnt= 2 mod=UserResourceMgr [MEMORY] hold= 448 used= 64 count= 2 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfFSCbNode [MEMORY] hold= 416 used= 2 count= 2 avg_used= 1 block_cnt= 2 chunk_cnt= 1 mod=ObLogEXTHandler [MEMORY] hold= 400 used= 208 count= 1 avg_used= 208 block_cnt= 1 chunk_cnt= 1 mod=[T]ObMacroBlock [MEMORY] hold= 400 used= 200 count= 1 avg_used= 200 block_cnt= 1 chunk_cnt= 1 mod=ExTabletMapLk [MEMORY] hold= 304 used= 102 count= 1 avg_used= 102 block_cnt= 1 chunk_cnt= 1 mod=TxLSLogBuf [MEMORY] hold= 304 used= 112 count= 1 avg_used= 112 block_cnt= 1 chunk_cnt= 1 mod=Coordinator [MEMORY] hold= 304 used= 104 count= 1 avg_used= 104 block_cnt= 1 chunk_cnt= 1 mod=RedoLogBuckLock [MEMORY] hold= 256 used= 56 count= 1 avg_used= 56 block_cnt= 1 chunk_cnt= 1 mod=ResRuleInfoMap [MEMORY] hold= 240 used= 41 count= 1 avg_used= 41 block_cnt= 1 chunk_cnt= 1 mod=KeepAliveBuf [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=RebuildCbNode [MEMORY] hold= 224 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PalfRCCbNode [MEMORY] hold= 208 used= 16 count= 1 avg_used= 16 block_cnt= 1 chunk_cnt= 1 mod=logservice [MEMORY] hold= 384,460,544 used= 376,307,127 count= 32,204 avg_used= 11,685 mod=SUMMARY [2025-04-21 14:09:49.257881] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:201018}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257904] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=49] [MEMORY] tenant_id= 1 ctx_id= MEMSTORE_CTX_ID hold= 182,452,224 used= 181,026,816 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 block_cnt= 87 chunk_cnt= 87 mod=Memstore [MEMORY] hold= 181,026,816 used= 180,943,992 count= 87 avg_used= 2,079,816 mod=SUMMARY [2025-04-21 14:09:49.257943] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:201234}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.257955] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= TRANS_CTX_MGR_ID hold= 2,097,152 used= 729,088 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 block_cnt= 1 chunk_cnt= 1 mod=PartTranCtxMgr [MEMORY] hold= 729,088 used= 722,560 count= 1 avg_used= 722,560 mod=SUMMARY [2025-04-21 14:09:49.258010] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200439}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258005] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=28] [MEMORY] tenant_id= 1 ctx_id= PLAN_CACHE_CTX_ID hold= 92,274,688 used= 88,452,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 83,453,440 used= 75,789,527 count= 3,772 avg_used= 20,092 block_cnt= 3,772 chunk_cnt= 44 mod=SqlPhyPlan [MEMORY] hold= 3,550,144 used= 3,337,968 count= 367 avg_used= 9,095 block_cnt= 367 chunk_cnt= 44 mod=SqlPlanCache [MEMORY] hold= 1,447,040 used= 1,319,360 count= 665 avg_used= 1,984 block_cnt= 222 chunk_cnt= 43 mod=CreateContext [MEMORY] hold= 1,984 used= 1,600 count= 2 avg_used= 800 block_cnt= 1 chunk_cnt= 1 mod=PlanCache [MEMORY] hold= 88,452,608 used= 80,448,455 count= 4,806 avg_used= 16,739 mod=SUMMARY [2025-04-21 14:09:49.258055] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= GLIBC hold= 2,097,152 used= 80,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 80,320 used= 58,751 count= 259 avg_used= 226 block_cnt= 21 chunk_cnt= 1 mod=PlJit [MEMORY] hold= 96 used= 32 count= 1 avg_used= 32 block_cnt= 1 chunk_cnt= 1 mod=PlCodeGen [MEMORY] hold= 80,416 used= 58,783 count= 260 avg_used= 226 mod=SUMMARY [2025-04-21 14:09:49.258076] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200718}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258096] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= CO_STACK hold= 121,634,816 used= 117,153,792 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 block_cnt= 227 chunk_cnt= 58 mod=CoStack [MEMORY] hold= 117,153,792 used= 116,935,872 count= 227 avg_used= 515,136 mod=SUMMARY [2025-04-21 14:09:49.258141] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200582}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258153] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=26] [MEMORY] tenant_id= 1 ctx_id= KVSTORE_CACHE_ID hold= 134,217,728 used= 134,217,728 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 block_cnt= 0 chunk_cnt= 0 mod=KvstorCacheMb [MEMORY] hold= 134,217,728 used= 0 count= 64 avg_used= 0 mod=SUMMARY [2025-04-21 14:09:49.258197] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=27] [MEMORY] tenant_id= 1 ctx_id= META_OBJ_CTX_ID hold= 6,291,456 used= 4,857,856 limit= 1,073,741,820 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 4,456,448 used= 4,439,040 count= 68 avg_used= 65,280 block_cnt= 68 chunk_cnt= 3 mod=N_TabletPool [MEMORY] hold= 401,408 used= 400,064 count= 2 avg_used= 200,032 block_cnt= 2 chunk_cnt= 1 mod=PoolFreeList [MEMORY] hold= 4,857,856 used= 4,839,104 count= 70 avg_used= 69,130 mod=SUMMARY [2025-04-21 14:09:49.258206] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200021}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258235] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= TX_CALLBACK_CTX_ID hold= 14,680,064 used= 5,218,176 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 block_cnt= 642 chunk_cnt= 7 mod=MemtableCallbac [MEMORY] hold= 5,218,176 used= 5,094,912 count= 642 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:49.258270] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200748}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258272] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= LOB_CTX_ID hold= 2,097,152 used= 8,128 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=LobPersist [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 mod=SUMMARY [2025-04-21 14:09:49.258309] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= PS_CACHE_CTX_ID hold= 2,097,152 used= 30,608 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 block_cnt= 7 chunk_cnt= 1 mod=SqlPsCache [MEMORY] hold= 30,608 used= 26,658 count= 20 avg_used= 1,332 mod=SUMMARY [2025-04-21 14:09:49.258335] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200759}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258366] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=24] [MEMORY] tenant_id= 1 ctx_id= TX_DATA_TABLE hold= 20,992,000 used= 19,764,544 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 17,862,592 used= 17,833,792 count= 3 avg_used= 5,944,597 block_cnt= 3 chunk_cnt= 2 mod=MEMTABLE_ARENA [MEMORY] hold= 1,893,824 used= 1,849,088 count= 233 avg_used= 7,936 block_cnt= 233 chunk_cnt= 2 mod=TX_DATA_SLICE [MEMORY] hold= 8,128 used= 7,936 count= 1 avg_used= 7,936 block_cnt= 1 chunk_cnt= 1 mod=TX_DATA_ARENA [MEMORY] hold= 19,764,544 used= 19,690,816 count= 237 avg_used= 83,083 mod=SUMMARY [2025-04-21 14:09:49.258399] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200576}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258413] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= MDS_DATA_ID hold= 2,097,152 used= 400,576 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 block_cnt= 15 chunk_cnt= 1 mod=TX_OP [MEMORY] hold= 400,576 used= 393,008 count= 15 avg_used= 26,200 mod=SUMMARY [2025-04-21 14:09:49.258464] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200815}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258467] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 1 ctx_id= MERGE_RESERVE_CTX_ID hold= 33,554,432 used= 0 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 33,554,432 free_size= 33,554,432 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [2025-04-21 14:09:49.258519] INFO [LIB] operator() (ob_malloc_allocator.cpp:522) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=23] [MEMORY] tenant: 500, limit: 9,223,372,036,854,775,807 hold: 776,400,896 rpc_hold: 0 cache_hold: 0 cache_used: 0 cache_item_count: 0 [MEMORY] ctx_id= DEFAULT_CTX_ID hold_bytes= 280,453,120 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= GLIBC hold_bytes= 16,777,216 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= CO_STACK hold_bytes= 109,051,904 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LIBEASY hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= LOGGER_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= RPC_CTX_ID hold_bytes= 4,194,304 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= PKT_NIO hold_bytes= 17,969,152 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= SCHEMA_SERVICE hold_bytes= 111,955,968 limit= 9,223,372,036,854,775,807 [MEMORY] ctx_id= UNEXPECTED_IN_500 hold_bytes= 227,610,624 limit= 9,223,372,036,854,775,807 [2025-04-21 14:09:49.258530] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200612}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258592] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=19] get multi version start(ls_id={id:1001}, tablet_id={id:200938}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258656] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200598}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258730] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200618}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258796] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:201378}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258861] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=21] get multi version start(ls_id={id:1001}, tablet_id={id:200692}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258924] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200745}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.258988] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200654}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.259051] INFO [STORAGE] get_kept_snapshot_info (ob_tablet.cpp:5968) [620316][T1002_SSTableGC][T1002][YB420B1D7AB6-00063343B83EFD8B-0-0] [lt=20] get multi version start(ls_id={id:1001}, tablet_id={id:200645}, snapshot_info={type:"SNAPSHOT_ON_TABLET", snapshot:1}, old_snapshot_info={type:"UNDO_RETENTION", snapshot:1745213981227903000}, min_medium_snapshot=9223372036854775807, min_reserved_snapshot_on_ls=1745213971218295000, max_merged_snapshot=1) [2025-04-21 14:09:49.259092] INFO [LIB] print_usage (ob_tenant_ctx_allocator.cpp:180) [619504][MemoryDump][T0][Y0-0000000000000000-0-0] [lt=25] [MEMORY] tenant_id= 500 ctx_id= DEFAULT_CTX_ID hold= 280,453,120 used= 251,526,416 limit= 9,223,372,036,854,775,807 [MEMORY] idle_size= 0 free_size= 0 [MEMORY] wash_related_chunks= 0 washed_blocks= 0 washed_size= 0 [MEMORY] request_cached_chunk_cnt= 0 [MEMORY] hold= 33,292,288 used= 33,275,904 count= 16 avg_used= 2,079,744 block_cnt= 16 chunk_cnt= 16 mod=ObTxDesc [MEMORY] hold= 31,477,760 used= 31,458,304 count= 1 avg_used= 31,458,304 block_cnt= 1 chunk_cnt= 1 mod=ash_list [MEMORY] hold= 28,631,040 used= 28,568,256 count= 7 avg_used= 4,081,179 block_cnt= 7 chunk_cnt= 5 mod=IoControl [MEMORY] hold= 18,186,240 used= 16,520,352 count= 222 avg_used= 74,416 block_cnt= 222 chunk_cnt= 35 mod=[T]ObSessionDIB [MEMORY] hold= 12,873,728 used= 12,856,352 count= 1 avg_used= 12,856,352 block_cnt= 1 chunk_cnt= 1 mod=MemDumpContext [MEMORY] hold= 9,457,664 used= 9,437,784 count= 1 avg_used= 9,437,784 block_cnt= 1 chunk_cnt= 1 mod=HashBuckInteChe [MEMORY] hold= 7,259,408 used= 6,324,350 count= 1,032 avg_used= 6,128 block_cnt= 539 chunk_cnt= 5 mod=CharsetInit [MEMORY] hold= 5,492,736 used= 5,417,824 count= 8 avg_used= 677,228 block_cnt= 8 chunk_cnt= 3 mod=KvstCachWashStr [MEMORY] hold= 5,373,952 used= 5,236,736 count= 32 avg_used= 163,648 block_cnt= 32 chunk_cnt= 12 mod=Iteratorget_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:49.397279] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:49.402066] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=19] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:49.402122] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:49.402147] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=21] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=37) [2025-04-21 14:09:49.402212] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.404173] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=20] ====== traversal_flush timer task ====== [2025-04-21 14:09:49.404296] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDAA-0-0] [lt=34] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215789316116000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:49.404424] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDAA-0-0] [lt=122] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:49.418620] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=90] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4100) [2025-04-21 14:09:49.420863] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=41] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:49.424987] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:49.428238] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=47] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4145, offset=100098}, end_cursor:ObLogCursor{file_id=3, log_id=4146, offset=100404}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77894050, len:2302, log_data_len:306, seq:4145, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:49.428636] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE91-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:49.428693] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE91-0-0] [lt=39] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215789260385000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215789260385000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:49.435578] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=68] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4146, offset=100404}, end_cursor:ObLogCursor{file_id=3, log_id=4147, offset=100701}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c77898050, len:1996, log_data_len:297, seq:4146, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:49.435848] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE91-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:49.435901] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE91-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215789260385000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215789260385000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:49.436820] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS SERVER] net_in=14kB/s, net_out=14kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:49.436877] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:49.437076] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:49.437252] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=30] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:49.437345] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:22, schedule:60, submit:9, rt:1533, total:1625) [2025-04-21 14:09:49.437419] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:49.437480] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:22, schedule:60, submit:9, device:1533, total:1625) [2025-04-21 14:09:49.437542] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:49.437614] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:797, total:812) [2025-04-21 14:09:49.437690] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=15] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:49.437726] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:797, total:812) [2025-04-21 14:09:49.437779] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:49.437804] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:49.441581] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=45] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:49.444062] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:49.444129] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=56] temporary file module use no blocks [2025-04-21 14:09:49.444172] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=39] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:49.444217] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=41] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:49.444253] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=35] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254993994279, flush_io_finished_ret_:0, flush_io_finished_round_:181, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:49.454733] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] ====== checkpoint timer task ====== [2025-04-21 14:09:49.455713] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=45] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:49.455775] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=61] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:49.455852] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:49.455960] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=102] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:49.456005] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=37] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:49.456032] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] get rec log scn(service_type_=0, rec_log_ts={val:1745215781308321001, v:0}) [2025-04-21 14:09:49.456050] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:49.456068] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:49.456090] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=15] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:49.456121] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=25] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:49.456145] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:49.456176] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=21][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:49.456210] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=33] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:49.456227] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=14] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:49.472877] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=148] get_max_applied_scn(scn={val:1745215789260385000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9200168}, palf_committed_end_scn_:{val:1745215789260385001, v:0}, last_check_scn_:{val:1745215789260385001, v:0}, max_applied_cb_scn_:{val:1745215789260385000, v:0}}) [2025-04-21 14:09:49.472951] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=68] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9200168}, readable_log_tail:{lsn:9200168}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57904600, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:49.474828] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=54] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.475332] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.475644] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=36] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.475723] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=25] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.478632] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=18] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:49.478699] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:49.483865] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=47] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:49.485092] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:49.485190] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215781227903000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:49.485235] INFO [STORAGE] inner_update_info (ob_tenant_freeze_info_mgr.cpp:704) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] ObTenantFreezeInfoMgr success to update infos(new_snapshot_gc_scn={val:1745215781227903000, v:0}, new_freeze_infos=[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}], new_snapshots=[], freeze_info_mgr_={is_inited:true, tenant_id:1002, freeze_info:{latest_snapshot_gc_scn:{val:1745215781227903000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}}) [2025-04-21 14:09:49.502288] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.515185] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:49.515874] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF020E-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.519400] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF020E-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254995069702, cache_obj->added_lc()=false, cache_obj->get_object_id()=772, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:49.521902] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=34] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:49.550173] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=88] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:49.562274] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=39] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:49.574490] INFO [SHARE] adaptive_update_limit (ob_share_throttle_define.cpp:112) [620303][T1002_TenantWea][T1001][YB420B1D7AB6-00063343B45F00DD-0-0] [lt=126] adaptive update(Tenant ID=1001, Config Specify Resource Limit(MB)=511, TxShare Current Memory Limit(MB)=398, Holding Memory(MB)=68, Tenant Remain Memory(MB)=550, Usable Remain Memory(MB)=330, Last Update Limit Timestamp=1745215789573707, Is Updated=true) [2025-04-21 14:09:49.584003] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:49.590614] INFO [MVCC] repeat_study (ob_multi_version_garbage_collector.cpp:197) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=24] skip repeat study(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215729588078, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215789590609, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:49.592333] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=64] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669580512000, snapshot_type=1, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:49.592376] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669124264000, snapshot_type=2, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:49.592415] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=33] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=1745215669124264000, snapshot_type=3, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:49.592462] INFO [MVCC] collect (ob_multi_version_garbage_collector.cpp:709) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=42] multi version garbage colloector collects successfully(sql= select snapshot_version, snapshot_type, svr_ip, svr_port, create_time, status from __all_reserved_snapshot where tenant_id = 1002 , snapshot_version=4611686018427387903, snapshot_type=4, create_time=1745215669581833, addr="11.29.122.182:2882", gc_status=0) [2025-04-21 14:09:49.592663] INFO [MVCC] decide_reserved_snapshot_version_ (ob_multi_version_garbage_collector.cpp:620) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=28] succeed to update global reserved snapshot(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215729588078, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, global_reserved_snapshot_={val:1745215669124264000, v:0}, reserved_snapshot={val:1745215669124264000, v:0}) [2025-04-21 14:09:49.592702] INFO [MVCC] refresh_ (ob_multi_version_garbage_collector.cpp:554) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=37] multi-version garbage collector refresh successfully(this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215729588078, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, collector={reserved_snapshot_version:{val:1745215669124264000, v:0}, reserved_snapshot_type:2, reserved_status:-1, reserved_create_time:1745215669581833, reserved_addr:"11.29.122.182:2882", is_this_server_disabled:false, status:0}) [2025-04-21 14:09:49.592734] INFO [MVCC] repeat_refresh (ob_multi_version_garbage_collector.cpp:232) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] repeat refresh successfully(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215789592732, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215789590677, GARBAGE_COLLECT_RETRY_INTERVAL=60000000) [2025-04-21 14:09:49.592757] INFO [MVCC] repeat_reclaim (ob_multi_version_garbage_collector.cpp:267) [620328][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] skip repeat reclaim(ret=0, this={this:0x7f3c385c0f30, last_study_timestamp:1745215669587631, last_refresh_timestamp:1745215789592732, last_reclaim_timestamp:1745215669591005, last_sstable_overflow_timestamp:0, has_error_when_study:false, refresh_error_too_long:false, has_error_when_reclaim:false, gc_is_disabled:false, global_reserved_snapshot:{val:1745215669124264000, v:0}, is_inited:true}, current_timestamp=1745215789592755, GARBAGE_COLLECT_EXEC_INTERVAL=600000000) [2025-04-21 14:09:49.596033] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:49.596087] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=38] temporary file module use no blocks [2025-04-21 14:09:49.596105] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:49.596126] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:49.596145] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254994146274, flush_io_finished_ret_:0, flush_io_finished_round_:181, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:49.602045] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:49.602094] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:49.602357] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.605656] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=42] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:49.608357] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:49.608400] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:49.610086] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=28][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:49.610120] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:49.644244] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=91] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:49.644298] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:49.646020] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1211, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:49.655828] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:49.655888] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=41] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=35) [2025-04-21 14:09:49.656747] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:49.656801] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=42] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:49.656833] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=29] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:49.656853] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=19] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=35) [2025-04-21 14:09:49.668833] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=94] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:49.668873] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=38] try gc retain ctx [2025-04-21 14:09:49.668887] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:49.668938] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=17] finish update min start scn(max_decided_scn={val:1745215789573707000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215779565380001, v:0}, keep_alive_scn_:{val:1745215784569395001, v:0}, update_ts_:1745215789668823}) [2025-04-21 14:09:49.669921] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=36] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215797945792000, latest_log_ts:{val:1745215781308321001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:49.691255] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=30] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:49.691318] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=47] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=37) [2025-04-21 14:09:49.694805] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=49] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:49.694870] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=43] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:49.694903] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=29] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=37) [2025-04-21 14:09:49.694904] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=46] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:49.695307] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=50] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.695323] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=52] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.695373] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=36] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.695598] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.695723] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.695937] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.696064] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=39] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.696088] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.696112] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.696455] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.696637] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:49.702429] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.714145] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=34] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:49.715369] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=44] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:49.715472] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215785621567000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:49.715681] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=65] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:49.716271] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=127] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9765) [2025-04-21 14:09:49.722059] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:49.744339] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:49.744433] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:49.744485] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:49.744525] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:49.744593] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:49.744633] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1211) [2025-04-21 14:09:49.746354] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:49.746430] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3432, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:49.746477] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=545, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:49.746513] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:49.746508] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=12] [APPLY STAT CB APPEND COST TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=64, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:49.746552] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=4060, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:49.746551] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=42] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=3288, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:49.746573] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=20] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:49.746580] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:49.746593] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=19] [APPLY STAT CB EXECUTE TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=-397, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:49.746614] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=19, stat_interval=5000000, avg (count/cost)=2955, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:49.755816] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDE0-0-0] [lt=36] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:49.759187] WDIAG begin (ob_hashtable.h:954) [620061][T1_L0_G0][T1][YB420B1D7AB6-00063343B94EFD87-0-0] [lt=19][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.761041] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=31] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=399, get_gts_with_stc_cnt=64, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=63, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:49.761383] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=48] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215789761362], gts:1745215789760921000, latest_srr:[mts=1745215789761362]}) [2025-04-21 14:09:49.761879] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620061][T1_L0_G0][T1][YB420B1D7AB6-00063343B94EFD87-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254995312159, cache_obj->added_lc()=false, cache_obj->get_object_id()=773, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:49.775157] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=16, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:49.795254] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD3-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.795260] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE3E-0-0] [lt=28][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.795279] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0478-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.797030] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:49.797392] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F047A-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.797428] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE40-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.798170] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F047B-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.802514] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=55][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.818896] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=19] ====== check clog disk timer task ====== [2025-04-21 14:09:49.818952] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=46] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:49.819582] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:49.819671] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=62] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:49.829346] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:49.841659] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=69] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:49.842701] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:49.842756] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=45] temporary file module use no blocks [2025-04-21 14:09:49.842774] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:49.842808] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=31] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:49.842833] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254994392905, flush_io_finished_ret_:0, flush_io_finished_round_:181, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:49.870877] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:64037846}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:66003249}, readable_log_tail:{lsn:66003249}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1101519, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:49.871082] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=202] get_replay_process success(id={id:1}, submitted_log_size=64037846, unsubmitted_log_size=0, replayed_log_size=64037846, unreplayed_log_size=0) [2025-04-21 14:09:49.871143] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [619846][T1_ReplayProces][T1][Y0-0000000000000000-0-0] [lt=29] dump tenant replay process(tenant_id=1, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=61, replayed_log_size(MB)=61, last_submitted_log_size(MB)=61, last_replayed_log_size(MB)=61, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:49.881535] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] Garbage Collector is running(seq_=19, gc_interval=10000000) [2025-04-21 14:09:49.881618] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=43] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:49.881652] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=23] gc_check_member_list_ cost time(ret=0, time_us=73) [2025-04-21 14:09:49.881680] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=20] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:49.881705] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=17] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:49.881731] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=21] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:49.881753] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=19] execute_gc cost time(ret=0, time_us=24) [2025-04-21 14:09:49.881773] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [619852][T1_GCCollector][T1][Y0-0000000000000000-0-0] [lt=15] ObSafeDestroyHandler start process [2025-04-21 14:09:49.891628] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43] ====== tenant freeze timer task ====== [2025-04-21 14:09:49.897382] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:49.897443] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:49.898715] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [619848][T1_CdcSrv][T1][Y0-0000000000000000-0-0] [lt=42] finish to resize log external storage handler(current_ts=1745215789898709, tenant_max_cpu=3, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:49.902579] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:49.916223] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=46] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:49.921181] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=42] blacklist_loop exec finished(cost_time=23, is_enabled=true, send_cnt=0) [2025-04-21 14:09:49.922212] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:49.925405] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=6200000, clean_num=200000) [2025-04-21 14:09:49.925619] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=47] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:49.949714] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:49.949767] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=48] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:49.949787] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:49.949810] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:49.953032] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=18] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:49.953750] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=714] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:49.960229] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3413, avg_group_log_size=379) [2025-04-21 14:09:49.962252] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1756, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:49.962200] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=29][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9200656}], scn_array=[cnt:1, {val:1745215789760921001, v:0}], curr_size=122, accum_size=1098, time_cost=17629) [2025-04-21 14:09:49.962298] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3413) [2025-04-21 14:09:49.962277] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17426924}], scn_array=[cnt:1, {val:1745215789760921001, v:0}], curr_size=122, accum_size=244, time_cost=17737) [2025-04-21 14:09:49.962334] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=35, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:49.962361] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3413) [2025-04-21 14:09:49.962416] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:49.962441] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1896, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:49.962461] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=31, avg_log_submit_to_flush_time=1839, avg_log_submit_to_slide_time=1864) [2025-04-21 14:09:49.962492] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=58, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:49.962526] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=34] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3413, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:49.966795] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=40] current monitor number(seq_=-1) [2025-04-21 14:09:49.974640] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F047D-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.976461] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F047F-0-0] [lt=65][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:49.977365] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1646, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:49.977427] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:49.977480] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:49.977519] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1781, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:49.977555] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:49.978834] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:49.978890] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.002650] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.010648] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=39] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:15164, max_lsn:66003371, max_scn:{val:1745215789818840001, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:64021792}, reuse_lsn:{lsn:66003371}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:64037846}}, last_submit_lsn:{lsn:66003249}, last_submit_end_lsn:{lsn:66003371}, last_submit_log_id:15164, last_submit_log_pid:3, max_flushed_lsn:{lsn:66003249}, max_flushed_end_lsn:{lsn:66003371}, max_flushed_log_pid:3, committed_end_lsn:{lsn:66003371}, last_slide_log_id:15164, last_slide_scn:{val:1745215789818840001, v:0}, last_slide_lsn:{lsn:66003249}, last_slide_end_lsn:{lsn:66003371}, last_slide_log_pid:3, last_slide_log_accum_checksum:960519892, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c6c7ba530}, [StateMgr]={this:0x7f3c6c7be830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:15165, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215614882766, palf_role_change_cb:0x7f3c6c7c5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_end_lsn:{lsn:64037846}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c6c7bbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:64021792}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/meta", dir_fd:128, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c6c7c09f8, flashback_version:0}, log_storage:{log_tail:{lsn:66003371}, readable_log_tail:{lsn:66003371}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1101397, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215614882435, this:0x7f3c6c7bef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:64037846}, saved_end_lsn:{lsn:64037846}, last_submit_prepare_req_time_us:1745215614883365, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c6c7be9b0}) [2025-04-21 14:09:50.010974] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=315] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215789962352, last_flushed_end_lsn:{lsn:66003371}}]) [2025-04-21 14:09:50.011001] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=15165, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215789962352, last_flushed_end_lsn:{lsn:66003371}}]) [2025-04-21 14:09:50.027991] INFO [STORAGE.COMPACTION] runTimerTask (ob_tenant_tablet_scheduler_task_mgr.cpp:162) [620318][T1002_MediumLoo][T1002][YB420B1D7AB6-00063343B73EFD8F-0-0] [lt=40] MediumCheckTask(cost_ts=13) [2025-04-21 14:09:50.040302] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4F-0-0] [lt=23] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12274, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:50.040791] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4F-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12274, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215790040767, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:50.040851] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE4F-0-0] [lt=57] success to process renew task(task={tenant_id:1, table_id:12274, add_timestamp:1745215790040229}, locations=[{table_id:12274, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215790040767, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:50.044207] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:50.046062] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=70] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3333, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:50.046112] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=39] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:50.046178] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:50.046206] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3462, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:50.046164] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=105] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:50.046240] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:50.063693] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0482-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.064312] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0483-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.068188] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=46] PNIO [ratelimit] time: 1745215790068184, bytes: 5457739, bw: 0.013174 MB/s, add_ts: 1007046, add_bytes: 13911 [2025-04-21 14:09:50.102227] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:50.102290] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.102735] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=64][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.110831] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=50] LogLoopThread round_cost_time(us)(round_cost_time=442) [2025-04-21 14:09:50.116493] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00D6-0-0] [lt=44] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:50.116831] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=58] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7888, avg_group_log_size=606) [2025-04-21 14:09:50.116876] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:50.118366] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7888) [2025-04-21 14:09:50.118461] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7888) [2025-04-21 14:09:50.118522] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1711, avg_log_submit_to_slide_time=1730) [2025-04-21 14:09:50.118550] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=12] get number(ret=0, service_type_=0, range=1, base_id=1745215790118198000, start_id=1745215790118198000, end_id=1745215790118198001) [2025-04-21 14:09:50.118570] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7888, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:50.118714] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=16] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215789916218000, v:0}, new_max_version={val:1745215789916218000, v:0}, last_min_version={val:1745215789715920000, v:0}, last_max_version={val:1745215789715920000, v:0}, total_time_us=3772, delta_us=202494) [2025-04-21 14:09:50.118754] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215789916218000, v:0}, min_version={val:1745215789916218000, v:0}, max_version={val:1745215789916218000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:50.122355] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:50.125903] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=32] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:50.135261] INFO [CLOG] do_thread_task_ (ob_remote_fetch_log_worker.cpp:249) [619849][T1_RFLWorker][T1][YB420B1D7AB6-00063343ABEEFD86-0-0] [lt=40] ObRemoteFetchWorker is running(thread_index=0) [2025-04-21 14:09:50.146296] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=3733, avg_log_submit_to_slide_time=3756) [2025-04-21 14:09:50.146331] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=27, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:50.146369] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=37] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=3819, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:50.146383] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:50.146396] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=12] [APPLY STAT CB EXECUTE TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=-470, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:50.146398] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:50.146409] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0452-0-0] [lt=12] [APPLY STAT CB TOTAL TIME](cur_stat_count=31, stat_interval=5000000, avg (count/cost)=3375, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:50.146399] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:50.146438] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=32, avg_log_submit_to_flush_time=3354, avg_log_submit_to_slide_time=3369) [2025-04-21 14:09:50.152585] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=89] PNIO [ratelimit] time: 1745215790152581, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007598, add_bytes: 0 [2025-04-21 14:09:50.202818] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.213851] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=115] BlockGCTimerTask success(ret=0, cost_time_us=17, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:50.215402] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=99] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:50.241516] WDIAG [SHARE] get_source (ob_log_restore_source_mgr.cpp:195) [620094][T1001_COMMONLSS][T1001][YB420B1D7AB6-00063343B3DEFE30-0-0] [lt=47][errcode=-4018] table_operator_ get_source failed(ret=-4018) [2025-04-21 14:09:50.261631] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=40] ts response task statistics(alloc_count=4110, free_count=2054) [2025-04-21 14:09:50.261684] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:50.269083] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [619786][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=111] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:50.302904] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.315073] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=23] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215790116068001, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198992, in_cluster_service=true, cluster_version={val:1745215789916218000, v:0}, min_cluster_version={val:1745215789916218000, v:0}, max_cluster_version={val:1745215789916218000, v:0}, get_cluster_version_err=0, cluster_version_delta=398842, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1656, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=125135653, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:50.322496] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:50.326401] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=51] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:50.346251] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1342) [2025-04-21 14:09:50.352323] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2F-0-0] [lt=19] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:50.352385] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE2F-0-0] [lt=58] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:50.397537] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:50.397596] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.402978] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.411704] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=49][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:50.412105] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=22] ====== check clog disk timer task ====== [2025-04-21 14:09:50.412151] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=40] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:50.413364] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=47] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:50.414975] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=36] get number(ret=0, service_type_=0, range=1, base_id=1745215790414863000, start_id=1745215790414863000, end_id=1745215790414863001) [2025-04-21 14:09:50.418900] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3958) [2025-04-21 14:09:50.425058] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=56] gc stale ls task succ [2025-04-21 14:09:50.439295] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=11kB/s, net_out=11kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:50.439355] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:50.439531] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:50.439718] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:50.439887] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:50.439965] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:615, total:627) [2025-04-21 14:09:50.440046] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:50.440104] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:615, total:627) [2025-04-21 14:09:50.440164] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:50.440189] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:50.441735] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=39] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:50.441759] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=44] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4147, offset=100701}, end_cursor:ObLogCursor{file_id=3, log_id=4148, offset=101007}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c7789c050, len:1699, log_data_len:306, seq:4147, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:50.442095] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE92-0-0] [lt=32] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:50.442148] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE92-0-0] [lt=33] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215790261141000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215790261141000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:50.447715] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=59] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4148, offset=101007}, end_cursor:ObLogCursor{file_id=3, log_id=4149, offset=101304}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778a0050, len:1393, log_data_len:297, seq:4148, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:50.447952] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE92-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:50.447993] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE92-0-0] [lt=26] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215790261141000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215790261141000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:50.456618] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:09:50.474995] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=43] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.475732] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.475786] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.475928] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=49] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.479007] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:50.479060] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.503051] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.522645] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:50.523064] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0211-0-0] [lt=68][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.525443] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0211-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254996075750, cache_obj->added_lc()=false, cache_obj->get_object_id()=774, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:50.526949] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=52] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:50.574942] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:09:50.575009] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=57] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:50.584076] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=34] gc stale ls task succ [2025-04-21 14:09:50.596303] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:50.596361] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=49] temporary file module use no blocks [2025-04-21 14:09:50.596379] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:50.596409] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:50.596435] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=24] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254995146501, flush_io_finished_ret_:0, flush_io_finished_round_:182, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:50.602429] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:50.602481] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=43] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.603121] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.605823] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=40] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:50.608777] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:50.608820] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:50.610491] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:50.610528] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:50.620955] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:50.645180] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:50.645247] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:50.646658] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:50.647304] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] ====== tenant freeze timer task ====== [2025-04-21 14:09:50.647350] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=38] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:50.647387] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=19] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:50.695038] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695205] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695373] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695424] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=59] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695454] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=37] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695513] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=35] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695634] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695720] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=40] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.695857] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.696031] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.696200] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=31] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:50.703214] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.717322] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=81] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:09:50.722827] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=60] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:50.727483] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:50.745237] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:50.745309] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:50.745341] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:50.745370] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:50.745416] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:50.745440] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:50.746936] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:50.747043] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=72] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3043, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:50.747188] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=129] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:50.747206] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:50.747240] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=33] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3189, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:50.747263] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=48, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:50.762131] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215790762118], gts:1745215790762002000, latest_srr:[mts=1745215790762118]}) [2025-04-21 14:09:50.775750] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=50] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:50.797146] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=40] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:50.797958] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=53] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:50.798790] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0485-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.798820] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE41-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.799189] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE42-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.800757] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0487-0-0] [lt=49][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.800757] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE44-0-0] [lt=30][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.801091] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE45-0-0] [lt=48][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.803284] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.819875] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:50.819952] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:50.829418] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:50.841648] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=25] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:50.841861] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=55] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:50.842922] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:50.842978] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:50.843027] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:50.843021] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215788818388000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:50.843052] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:50.843079] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:50.843102] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254995393197, flush_io_finished_ret_:0, flush_io_finished_round_:182, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:50.846835] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=17432118, this={dio_aligned_buf:{buf_write_offset:3760, buf_padding_size:336, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:3734, truncate_used_ts:1477}, log_block_size:67108864, dir_fd:151, io_fd:152}, aligned_buf_len=4096, aligned_block_offset=17428480, buf_len=122, total_write_size=13719, total_write_size_after_dio=421888, ob_pwrite_used_ts=270088, count=100, each_pwrite_cost=2700) [2025-04-21 14:09:50.895645] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=62] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:50.897719] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:50.897804] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=76] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.903354] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=51][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:50.926898] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=49] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:50.927823] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=59] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8700000, replace_num=100000) [2025-04-21 14:09:50.927875] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:50.927962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43573755904, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:50.960878] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3958, avg_group_log_size=395) [2025-04-21 14:09:50.973979] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=50] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:50.977374] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1460, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:50.977433] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:50.977491] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:50.977535] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=43] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1595, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:50.977572] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:50.977669] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0489-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.979173] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=26] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:50.979220] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:50.979252] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F048B-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:50.996347] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=97] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}) [2025-04-21 14:09:51.000271] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=39] LogLoopThread round_cost_time(us)(round_cost_time=30) [2025-04-21 14:09:51.003422] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.021515] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1331, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:51.021559] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=43] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=4542) [2025-04-21 14:09:51.021602] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=30, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:51.021643] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=4542) [2025-04-21 14:09:51.021711] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:51.021741] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1451, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:51.021762] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=5, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1406, avg_log_submit_to_slide_time=1425) [2025-04-21 14:09:51.021799] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=49, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:51.021900] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=4542, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:51.030301] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=41] set tenant work area memory(tenant_id=1001, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:51.030413] INFO [SERVER] update_tenant_wa_percentage (ob_tenant_duty_task.cpp:243) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=40] set tenant work area memory(tenant_id=1002, wa_pctg=5, limit=157286400, ret=0) [2025-04-21 14:09:51.040994] INFO [STORAGE] runTimerTask (ob_tenant_memory_printer.cpp:32) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=24] === Run print tenant memory usage task === [2025-04-21 14:09:51.041084] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:102) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=43] ====== tenants memory info ====== === TENANTS MEMORY INFO === divisive_memory_used= 137,773,056 [TENANT_MEMORY] tenant_id= 500 mem_tenant_limit= 9,223,372,036,854,775,807 mem_tenant_hold= 778,498,048 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 508 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 40,697,856 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 509 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 26,017,792 kv_cache_mem= 0 [TENANT_MEMORY] tenant_id= 1 now= 1,745,215,791,040,616 active_memstore_used= 182,452,224 total_memstore_used= 182,452,224 total_memstore_hold= 182,452,224 memstore_freeze_trigger_limit= 429,496,720 memstore_limit= 2,147,483,640 mem_tenant_limit= 5,368,709,120 mem_tenant_hold= 1,081,163,776 max_mem_memstore_can_get_now= 2,456,731,648 memstore_alloc_pos= 182,452,224 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,001 now= 1,745,215,791,040,616 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 71,514,920 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 555,724,800 max_mem_memstore_can_get_now= 357,574,616 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [TENANT_MEMORY] tenant_id= 1,002 now= 1,745,215,791,040,616 active_memstore_used= 69,206,016 total_memstore_used= 69,206,016 total_memstore_hold= 69,206,016 memstore_freeze_trigger_limit= 61,686,560 memstore_limit= 429,496,720 mem_tenant_limit= 1,073,741,824 mem_tenant_hold= 664,494,080 max_mem_memstore_can_get_now= 308,432,866 memstore_alloc_pos= 69,206,016 memstore_frozen_pos= 0 memstore_reclaimed_pos= 0 [2025-04-21 14:09:51.041091] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=27] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:51.041138] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=45] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:51.041138] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD98-0-0] [lt=29] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:51.041175] INFO [STORAGE] print_tenant_usage (ob_tenant_memory_printer.cpp:114) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=21] [CHUNK_MGR] limit= 51,539,607,552 hold= 3,224,395,776 total_hold= 3,395,289,088 used= 3,144,499,200 freelists_hold= 79,896,576 total_maps= 1,224 total_unmaps= 26 large_maps= 106 large_unmaps= 0 huge_maps= 28 huge_unmaps= 22 memalign=0 resident_size= 3,912,089,600 divisive_memory_used= 137,773,056 virtual_memory_used= 4,602,413,056 [CHUNK_MGR] 2 MB_CACHE: hold= 29,360,128 free= 14 pushes= 347,544 pops= 347,530 maps= 1,090 unmaps= 4 [CHUNK_MGR] 4 MB_CACHE: hold= 6,352,896 free= 3 pushes= 172 pops= 169 maps= 59 unmaps= 0 [CHUNK_MGR] 6 MB_CACHE: hold= 4,255,744 free= 1 pushes= 3 pops= 2 maps= 13 unmaps= 0 [CHUNK_MGR] 8 MB_CACHE: hold= 12,623,872 free= 2 pushes= 179 pops= 177 maps= 4 unmaps= 0 [CHUNK_MGR] 10 MB_CACHE: hold= 8,409,088 free= 1 pushes= 1 pops= 0 maps= 17 unmaps= 0 [CHUNK_MGR] 12 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 0 unmaps= 0 [CHUNK_MGR] 14 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 2 unmaps= 0 [CHUNK_MGR] 16 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 4 unmaps= 0 [CHUNK_MGR] 18 MB_CACHE: hold= 16,797,696 free= 1 pushes= 2 pops= 1 maps= 6 unmaps= 0 [CHUNK_MGR] 20 MB_CACHE: hold= 0 free= 0 pushes= 0 pops= 0 maps= 1 unmaps= 0 [2025-04-21 14:09:51.041180] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD98-0-0] [lt=39] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:51.041220] INFO print (ob_malloc_time_monitor.cpp:37) [619485][ServerGTimer][T0][Y0-0000000000000000-0-0] [lt=24] [MALLOC_TIME_MONITOR] show the distribution of ob_malloc's cost_time [MALLOC_TIME_MONITOR] [ 1000, 10000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 10000, 100000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 100000, 1000000): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [MALLOC_TIME_MONITOR] [ 1000000, 9223372036854775807): delta_total_cost_time= 0, delta_count= 0, avg_cost_time= 0 [2025-04-21 14:09:51.044329] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:51.046779] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1427, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:51.046838] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=48] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=26, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:51.046850] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:51.046907] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:51.046938] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1539, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:51.046972] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:51.067434] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F048E-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.067969] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F048F-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.068780] INFO [BALANCE.TRANSFER] do_work (ob_tenant_transfer_service.cpp:146) [620257][T1002_TntTransf][T1002][YB420B1D7AB6-00063343B50EFD97-0-0] [lt=43] [TENANT_TRANSFER] finish one round(ret=0, ret="OB_SUCCESS", all_tasks_count=0, thread_task_count=0, thread_idx=0) [2025-04-21 14:09:51.074583] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215781072026, end_time=1745215791074579, dag_status={}) [2025-04-21 14:09:51.074633] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=46] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074665] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074696] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=30] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074710] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074729] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074749] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074775] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074793] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074805] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=12] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:51.074825] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074852] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074872] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074890] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074909] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074927] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074945] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074962] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074981] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.074998] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075016] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075045] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075064] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075082] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075101] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075119] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075138] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075155] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075175] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075193] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075211] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075247] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075261] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075275] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=13] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075293] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075328] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075346] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075363] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075381] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075399] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075417] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075434] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075452] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075469] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075487] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075504] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075522] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075539] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075558] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075575] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075593] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075610] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075628] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075646] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075664] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075681] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075698] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075716] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075733] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075786] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075806] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075825] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075844] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075862] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075880] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075898] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075915] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075932] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075967] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.075985] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076003] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076021] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076039] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076058] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076076] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:51.076095] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:51.076113] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=16] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:51.076131] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=17] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:51.076146] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:51.076161] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:51.076172] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=10] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:51.076188] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:51.076204] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=15] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:51.076219] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:51.076233] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:51.076249] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [619825][T1_DagScheduler][T1][Y0-0000000000000000-0-0] [lt=14] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:51.076345] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=56] PNIO [ratelimit] time: 1745215791076341, bytes: 5472064, bw: 0.013551 MB/s, add_ts: 1008157, add_bytes: 14325 [2025-04-21 14:09:51.102584] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:51.102635] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.103488] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.116967] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00DB-0-0] [lt=46] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:51.117285] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7771, avg_group_log_size=647) [2025-04-21 14:09:51.117328] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:51.118938] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7771) [2025-04-21 14:09:51.119022] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=29] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7771) [2025-04-21 14:09:51.119085] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1558, avg_log_submit_to_slide_time=1577) [2025-04-21 14:09:51.119146] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7771, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:51.119262] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=25] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215790916948000, v:0}, new_max_version={val:1745215790916948000, v:0}, last_min_version={val:1745215790716741000, v:0}, last_max_version={val:1745215790716741000, v:0}, total_time_us=3599, delta_us=202311) [2025-04-21 14:09:51.119301] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215790916948000, v:0}, min_version={val:1745215790916948000, v:0}, max_version={val:1745215790916948000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:51.127992] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=25] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:51.128521] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=61] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:51.140549] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=31] success to update min reserved snapshot(reserved_snapshot=1745213981227903000, duration=1800, snapshot_gc_ts=1745215781227903000) [2025-04-21 14:09:51.143521] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=9206216, this={dio_aligned_buf:{buf_write_offset:2616, buf_padding_size:1480, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4645, truncate_used_ts:1945}, log_block_size:67108864, dir_fd:154, io_fd:155}, aligned_buf_len=4096, aligned_block_offset=9203712, buf_len=112, total_write_size=13405, total_write_size_after_dio=421888, ob_pwrite_used_ts=228066, count=100, each_pwrite_cost=2280) [2025-04-21 14:09:51.143758] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] update reserved snapshot finished(cost_ts=3212, reserved_snapshot=1745213981227903000) [2025-04-21 14:09:51.146889] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1332) [2025-04-21 14:09:51.146963] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1456, avg_log_submit_to_slide_time=1478) [2025-04-21 14:09:51.147022] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=31] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=12, avg_log_submit_to_flush_time=1463, avg_log_submit_to_slide_time=1476) [2025-04-21 14:09:51.147067] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1332, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:51.160193] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215791160189, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007608, add_bytes: 0 [2025-04-21 14:09:51.161423] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=22] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1002) [2025-04-21 14:09:51.161466] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=39] start lib cache evict(tenant_id=1002, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:51.161490] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=21] end lib cache evict(tenant_id=1002, cache_evict_num=0, mem_hold=44040192, mem_limit=53687090, cache_obj_num=153, cache_node_num=152) [2025-04-21 14:09:51.161510] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=19] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:51.164659] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=16] Dumping All Cache Objs(alloc_obj_list.count()=153, alloc_obj_list=[{obj_id:2, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:3, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:4, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:7, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:12, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:18, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:19, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:21, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:24, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186439}, {obj_id:26, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181680}, {obj_id:27, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:29, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173904}, {obj_id:30, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196122}, {obj_id:31, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187488}, {obj_id:32, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:35, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:41, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:80, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:84, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:85, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:98, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:99, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:100, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:106, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:111, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202867}, {obj_id:112, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:113, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:115, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:116, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:117, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:118, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:122, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179954}, {obj_id:123, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:207190}, {obj_id:124, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185551}, {obj_id:125, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194035}, {obj_id:126, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165860}, {obj_id:127, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:128, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197460}, {obj_id:129, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176496}, {obj_id:130, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178232}, {obj_id:131, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189121}, {obj_id:132, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190685}, {obj_id:133, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157322}, {obj_id:134, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225623}, {obj_id:135, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260724}, {obj_id:136, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194942}, {obj_id:137, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264023}, {obj_id:138, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186568}, {obj_id:139, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195114}, {obj_id:140, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:269829}, {obj_id:141, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:268203}, {obj_id:142, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266488}, {obj_id:143, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267124}, {obj_id:144, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:264546}, {obj_id:145, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266506}, {obj_id:146, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263969}, {obj_id:147, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263693}, {obj_id:148, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:260218}, {obj_id:149, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:266691}, {obj_id:150, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196647}, {obj_id:151, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196588}, {obj_id:152, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238181}, {obj_id:153, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:238081}, {obj_id:154, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273713}, {obj_id:155, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:276109}, {obj_id:156, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:273590}, {obj_id:157, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239477}, {obj_id:158, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239478}, {obj_id:159, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203164}, {obj_id:160, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177940}, {obj_id:161, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198349}, {obj_id:162, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182009}, {obj_id:163, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183251}, {obj_id:164, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:165, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:166, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:167, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:168, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:169, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:170, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:172, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:173, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:174, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:175, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:176, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:177, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:178, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:179, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:204, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156576}, {obj_id:205, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:157361}, {obj_id:214, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185675}, {obj_id:231, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193487}, {obj_id:232, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203314}, {obj_id:233, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181883}, {obj_id:234, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176297}, {obj_id:235, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188557}, {obj_id:236, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200471}, {obj_id:237, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189763}, {obj_id:238, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196192}, {obj_id:239, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180688}, {obj_id:240, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181599}, {obj_id:241, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206236}, {obj_id:242, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193077}, {obj_id:243, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:244, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198030}, {obj_id:245, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192897}, {obj_id:246, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189804}, {obj_id:247, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177851}, {obj_id:248, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182740}, {obj_id:249, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197658}, {obj_id:250, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182478}, {obj_id:251, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177600}, {obj_id:252, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156381}, {obj_id:254, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179629}, {obj_id:256, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:257, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195090}, {obj_id:260, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:261, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:263, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183074}, {obj_id:265, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:266, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199550}, {obj_id:267, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176793}, {obj_id:268, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187298}, {obj_id:269, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222848}, {obj_id:270, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:229978}, {obj_id:271, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199513}, {obj_id:272, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:389810}, {obj_id:273, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179456}, {obj_id:274, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:275, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:276, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200206}, {obj_id:277, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192712}, {obj_id:278, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188298}, {obj_id:279, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317463}, {obj_id:280, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184513}, {obj_id:281, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181451}, {obj_id:282, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182100}, {obj_id:283, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:318842}, {obj_id:284, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:270540}, {obj_id:285, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184496}, {obj_id:286, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:251738}, {obj_id:287, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192950}, {obj_id:288, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182921}, {obj_id:289, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189754}, {obj_id:290, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182132}, {obj_id:291, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201901}, {obj_id:292, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174568}, {obj_id:294, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176367}, {obj_id:295, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184208}, {obj_id:300, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185287}, {obj_id:301, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185286}, {obj_id:303, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:304, tenant_id:1002, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:51.165020] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620243][T1002_PlanCache][T1002][Y0-0000000000000000-0-0] [lt=358] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:51.203572] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.212289] INFO [SHARE] get_balance_job (ob_balance_job_table_operator.cpp:209) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=48] empty balance job(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=select time_to_usec(gmt_create) as start_time, time_to_usec(gmt_modified) as finish_time, * from __all_balance_job) [2025-04-21 14:09:51.213605] INFO [BALANCE] build (ob_transfer_partition_task.cpp:120) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=40] [TRANSFER_PARTITION] no transfer partition task(tenant_id_=1002) [2025-04-21 14:09:51.213645] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1010) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=38] no transfer partition job [2025-04-21 14:09:51.213664] INFO [BALANCE] transfer_partition_ (ob_tenant_balance_service.cpp:1040) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=14] [TENANT_BALANCE] finish transfer partition(ret=0, ret="OB_SUCCESS", job_cnt=0, enable transfer=true) [2025-04-21 14:09:51.216180] INFO [BALANCE] gather_ls_status_stat (ob_tenant_balance_service.cpp:284) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=22] [TENANT_BALANCE] LS no need balance(ls_status={tenant_id:1002, ls_id:{id:1}, ls_group_id:0, status:"NORMAL", unit_group_id:0, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}) [2025-04-21 14:09:51.216237] INFO [BALANCE] ls_balance_ (ob_tenant_balance_service.cpp:493) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=44] [TENANT_BALANCE] finish ls balance(ret=0, ret="OB_SUCCESS", need_ls_balance=false, job={tenant_id:0, job_id:{id:-1}, job_type:{val:-1, job_type:"INVALID"}, job_status:{val:-1, job_status:"INVALID"}, primary_zone_num:0, unit_group_num:0, comment:, balance_strategy:}, tasks=[]) [2025-04-21 14:09:51.216278] INFO [BALANCE] do_work (ob_tenant_balance_service.cpp:157) [620238][T1002_TBalance][T1002][YB420B1D7AB6-00063343B4FEFD97-0-0] [lt=33] [TENANT_BALANCE] finish one round(ret=0, ret="OB_SUCCESS", tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, job_cnt=0, primary_zone_num_=1, unit_group_array_=[{unit_group_id:1001, status:0}], ls_array_=[{tenant_id:1002, ls_id:{id:1001}, ls_group_id:1001, status:"NORMAL", unit_group_id:1001, primary_zone:"zone1", flag:{flag:0, is_duplicate:false, is_block_tablet_in:false}}], idle_time_us=10000000, last_partition_balance_time=1745215620473856, last_statistic_bg_stat_time=1745215621038654, last_statistic_schema_version=1745214625396896, last_statistic_max_transfer_task_id={id:-1}, enable_rebalance=true, enable_transfer=true) [2025-04-21 14:09:51.262644] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=49] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215791262615], gts:1745215791262320000, latest_srr:[mts=1745215791262615]}) [2025-04-21 14:09:51.262704] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=58] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:51.265584] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDE-0-0] [lt=41] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:51.265627] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDE-0-0] [lt=36] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=46) [2025-04-21 14:09:51.303609] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.317207] INFO [STORAGE.TRANS] alloc (ob_trans_factory.cpp:141) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00DC-0-0] [lt=24] ObTransCtx statistics(active_coord_ctx_count=0, active_part_ctx_count=1, total_release_part_ctx_count=94) [2025-04-21 14:09:51.317510] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] submit log success(service_type_=0, last_id=1745215807945792000, limited_id=1745215807945792000) [2025-04-21 14:09:51.317546] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=35] submit log with lock success(service_type_=0, last_id=1745215807945792000, limited_id=1745215807945792000) [2025-04-21 14:09:51.319095] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=39] update id meta(ret=0, service_type=0, limited_id=1745215807945792000, latest_scn={val:1745215791316720001, v:0}, *this={tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215807945792000, latest_log_ts:{val:1745215791316720001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:51.319221] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=124] handle submit callback(service_type_=0, success=true, used_ts=1711, log_ts={val:1745215791316720001, v:0}, limited_id=1745215807945792000) [2025-04-21 14:09:51.319245] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:51.319269] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:51.328117] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:51.329130] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=73] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:51.354264] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE30-0-0] [lt=32] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:51.354321] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE30-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:51.397917] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=57] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:51.397984] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.403688] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.420316] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=16] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3412) [2025-04-21 14:09:51.425131] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=39] gc stale ls task succ [2025-04-21 14:09:51.441150] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=16] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:51.441214] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:51.441388] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:51.441589] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:51.441675] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8176, [delay/us]:prepare:13, schedule:45, submit:9, rt:1272, total:1339) [2025-04-21 14:09:51.441751] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:51.441843] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=82] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8175, [delay/us]: prepare:13, schedule:45, submit:9, device:1272, total:1339) [2025-04-21 14:09:51.441941] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=45] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:51.442037] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:611, total:623) [2025-04-21 14:09:51.442122] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:51.442162] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=36] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:611, total:623) [2025-04-21 14:09:51.442222] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=11] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:51.442250] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:51.441886] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=35] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:51.444470] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=55] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:51.444515] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=35] temporary file module use no blocks [2025-04-21 14:09:51.444532] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=14] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:51.444557] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:51.444585] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=27] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254995994708, flush_io_finished_ret_:0, flush_io_finished_round_:183, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:51.447154] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1332) [2025-04-21 14:09:51.453355] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=40] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4149, offset=101304}, end_cursor:ObLogCursor{file_id=3, log_id=4150, offset=101610}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778a4050, len:1096, log_data_len:306, seq:4149, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:51.453763] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE93-0-0] [lt=29] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:51.453835] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE93-0-0] [lt=46] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215791239977001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215791239977001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:51.460436] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=75] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4150, offset=101610}, end_cursor:ObLogCursor{file_id=3, log_id=4151, offset=101907}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778a8050, len:790, log_data_len:297, seq:4150, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:51.460813] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE93-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:51.460885] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE93-0-0] [lt=53] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215791239977001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215791239977001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:51.475046] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.475524] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=41] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.475803] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.475864] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=21] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.479344] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:51.479392] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=41] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.503758] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=48][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.528250] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=46] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:51.529457] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0213-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.529690] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43573755904, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:51.531941] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0213-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254997082249, cache_obj->added_lc()=false, cache_obj->get_object_id()=775, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:51.558919] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=84] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:51.574442] INFO [STORAGE.TRANS] get_cluster_version (ob_tenant_weak_read_cluster_version_mgr.cpp:166) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=50] [WEAK_READ_SERVER_VERSION_MGR] compute version(tenant_id=1002, min_version={val:1745215791262320000, v:0}, base_version={val:1745215790762002004, v:0}, server_count=1, svr_array=[{addr:"11.29.122.182:2882", version:{val:1745215791262320000, v:0}, valid_part_count:2, total_part_count:2, generate_tstamp:1745215791574393, is_skipped:false}], skip_server_count=0, skip_servers=[]) [2025-04-21 14:09:51.584163] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:51.596581] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=43] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:51.596677] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=83] temporary file module use no blocks [2025-04-21 14:09:51.596784] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=102] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:51.596835] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:51.596875] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=37] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254996146795, flush_io_finished_ret_:0, flush_io_finished_round_:183, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:51.602859] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:51.602930] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.603829] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.606021] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=64] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:51.609101] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=16][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:51.609148] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:51.610920] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:51.610963] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:51.645948] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=13] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:51.646007] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=47] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:51.646145] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1002) [2025-04-21 14:09:51.647604] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1903, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:51.647975] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620258][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=50] get number(ret=0, service_type_=0, range=1, base_id=1745215791647661000, start_id=1745215791647661000, end_id=1745215791647661001) [2025-04-21 14:09:51.657541] INFO [SHARE] get_server_tenant_configs (ob_unit_getter.cpp:243) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=20] get_server_tenant_configs(unit_infos=[{unit:unit_id:1, resource_pool_id:1, unit_group_id:1, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, pool:{resource_pool_id:1, name:"sys_pool", unit_count:1, unit_config_id:1, zone_list:["zone1"], tenant_id:1, replica_type:0}}, {unit:unit_id:1001, resource_pool_id:1001, unit_group_id:1001, zone:"zone1", server:"11.29.122.182:2882", migrate_from_server:"0.0.0.0:0", is_manual_migrate:false, status:0, replica_type:0, config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, pool:{resource_pool_id:1001, name:"ocp_meta_pool", unit_count:1, unit_config_id:1001, zone_list:["zone1"], tenant_id:1002, replica_type:0}}]) [2025-04-21 14:09:51.657633] INFO [SHARE] get_compat_mode (ob_unit_getter.cpp:828) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=82] jx_debug: get tenant compatibility mode(tenant_id=1002, compat_mode=0) [2025-04-21 14:09:51.657653] INFO [SHARE] divide_meta_tenant (ob_unit_resource.cpp:1111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=16] divide meta tenant resource finish(ret=0, ret="OB_SUCCESS", meta_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, user_resource={min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }, unit_resource={min_cpu:1, max_cpu:1, memory_size:"2GB", log_disk_size:"6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }) [2025-04-21 14:09:51.657690] INFO [SHARE] divide_meta_tenant (ob_unit_getter.cpp:134) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=35] divide meta tenant finish(ret=0, ret="OB_SUCCESS", meta_tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}, user_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:0, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:51.660416] INFO [SHARE] refresh_resource_plan (ob_resource_plan_manager.cpp:187) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=40] refresh resource plan success(tenant_id=1, plan_name=, directives=[]) [2025-04-21 14:09:51.662077] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=39] refresh resource user mapping rule(tenant_id=1, plan=, user_rules=[]) [2025-04-21 14:09:51.663570] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=40] refresh resource mapping rule(tenant_id=1, plan=, rules=[]) [2025-04-21 14:09:51.663610] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1, plan=) [2025-04-21 14:09:51.664908] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=15] trace tenant dfc parameters(max_parallel_cnt_=30, max_blocked_buffer_size_=9830400, max_buffer_size_=19660800) [2025-04-21 14:09:51.665021] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=38] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:51.665053] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=28] tenant dfc status(ret=0, get_tenant_id()=1, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=30, get_max_blocked_buffer_size()=9830400, get_max_buffer_size()=19660800, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:51.669391] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=36] refresh resource user mapping rule(tenant_id=1001, plan=, user_rules=[]) [2025-04-21 14:09:51.670879] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=38] refresh resource mapping rule(tenant_id=1001, plan=, rules=[]) [2025-04-21 14:09:51.670920] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1001, plan=) [2025-04-21 14:09:51.672223] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:51.672330] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=40] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:51.672358] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=25] tenant dfc status(ret=0, get_tenant_id()=1001, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:51.676729] INFO [SHARE] refresh_resource_user_mapping_rule (ob_resource_mapping_rule_manager.cpp:140) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=23] refresh resource user mapping rule(tenant_id=1002, plan=, user_rules=[]) [2025-04-21 14:09:51.678239] INFO [SHARE] refresh_resource_function_mapping_rule (ob_resource_mapping_rule_manager.cpp:178) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=38] refresh resource mapping rule(tenant_id=1002, plan=, rules=[]) [2025-04-21 14:09:51.678279] INFO [SHARE] refresh_resource_mapping_rule (ob_resource_mapping_rule_manager.cpp:100) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=39] refresh resource mapping rule success(tenant_id=1002, plan=) [2025-04-21 14:09:51.679587] INFO [SQL.DTL] calc_max_buffer (ob_dtl_fc_server.cpp:155) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=14] trace tenant dfc parameters(max_parallel_cnt_=10, max_blocked_buffer_size_=3276800, max_buffer_size_=6553600) [2025-04-21 14:09:51.679699] INFO [SQL.DTL] auto_free_on_time (ob_dtl_tenant_mem_manager.cpp:232) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=36] auto free to reserve buffer count(reserve_buffer_min_size=16777216, max_reserve_count=2, buffer_size=65536, ret=0) [2025-04-21 14:09:51.679725] INFO [SQL.DTL] clean_on_timeout (ob_dtl_fc_server.cpp:127) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=24] tenant dfc status(ret=0, get_tenant_id()=1002, get_channel_cnt()=0, get_current_buffer_used()=0, get_current_blocked_cnt()=0, get_current_buffer_cnt()=0, get_max_parallel()=10, get_max_blocked_buffer_size()=3276800, get_max_buffer_size()=6553600, get_accumulated_blocked_cnt()=0, get_max_size_per_channel()=655360) [2025-04-21 14:09:51.679754] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:111) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=17] refresh tenant units(sys_unit_cnt=1, units=[{tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}, {tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}], ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:51.679821] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=60] finish set nway(tenant_id_=1, nway=3) [2025-04-21 14:09:51.679843] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=19] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1, nway=3, new_tma_limit=1288490160, pre_tma_limit=1288490160, cur_memstore_limit_percent=40, tenant_config={tenant_id:1, unit_id:1, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1, name:"sys_unit_config", resource:{min_cpu:3, max_cpu:3, memory_size:"2GB", log_disk_size:"5GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:3, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:3, }}, mode:0, create_timestamp:1745213949229989, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:51.679874] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=28] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=4.095999984741210938e+02, this=0x7f3c6e5d2170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=2047, Resource Limit(MB)=2047, Throttle Trigger(MB)=1228, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=1.018203729649071132e+00) [2025-04-21 14:09:51.679906] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=30] succ to set_memstore_threshold of memstore allocator(tenant_id=1, ret=0) [2025-04-21 14:09:51.679927] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=17] finish set nway(tenant_id_=1002, nway=1) [2025-04-21 14:09:51.679943] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=15] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1002, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1002, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"5.4GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:51.679968] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c39c50170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:51.679991] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1002][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=22] succ to set_memstore_threshold of memstore allocator(tenant_id=1002, ret=0) [2025-04-21 14:09:51.680012] INFO set_nway (ob_tenant_mutil_allocator.cpp:392) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=15] finish set nway(tenant_id_=1001, nway=1) [2025-04-21 14:09:51.680029] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:403) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=17] ObTenantMutilAllocator update tenant mem_limit finished(ret=0, tenant_id=1001, nway=1, new_tma_limit=644245080, pre_tma_limit=644245080, cur_memstore_limit_percent=40, tenant_config={tenant_id:1001, unit_id:1001, has_memstore:true, unit_status:"NORMAL", config:{unit_config_id:1001, name:"ocp_meta_unit", resource:{min_cpu:1, max_cpu:1, memory_size:"1GB", log_disk_size:"0.6GB", data_disk_size:0, min_iops:9223372036854775807, max_iops:9223372036854775807, iops_weight:1, max_net_bandwidth:INT64_MAX, net_bandwidth_weight:1, }}, mode:0, create_timestamp:1745214041965239, is_removed:false, hidden_sys_data_disk_config_size:0}) [2025-04-21 14:09:51.680055] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:287) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=23] [Throttle] Update Throttle Unit Config(is_adaptive_update=false, N=8.191999816894531250e+01, this=0x7f3c4d850170, enable_adaptive_limit_=false, Unit Name=Memstore, Config Specify Resource Limit(MB)=409, Resource Limit(MB)=409, Throttle Trigger(MB)=245, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.241572899671315326e+02) [2025-04-21 14:09:51.680078] INFO update_tenant_mem_limit (ob_tenant_mutil_allocator_mgr.cpp:412) [619730][OmtNodeBalancer][T1001][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=23] succ to set_memstore_threshold of memstore allocator(tenant_id=1001, ret=0) [2025-04-21 14:09:51.681294] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=16] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:51.681336] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=38] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1001, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:51.681352] INFO [SERVER.OMT] refresh_tenants (ob_tenant_config_mgr.cpp:225) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=15] [DATA_VERSION] periodically update data_version(tmp_ret=0, tmp_ret="OB_SUCCESS", tenant_id=1002, value_updated=true, data_version={version_str:"4.3.4.1", version_val:17180066817}) [2025-04-21 14:09:51.681400] INFO [SERVER] cal_all_part_disk_default_percentage (ob_server_utils.cpp:301) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=18] cal_all_part_disk_default_percentage succ(data_dir="/home/oceanbase/tianxing/oceanbase/store/sstable", clog_dir="/home/oceanbase/tianxing/oceanbase/store/clog", shared_mode=true, data_disk_total_size=2065344266240, data_disk_default_percentage=60, clog_disk_total_size=2065344266240, clog_disk_default_percentage=30) [2025-04-21 14:09:51.681428] INFO [SERVER] decide_disk_size (ob_server_utils.cpp:337) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=26] decide disk size finished(suggested_disk_size=139586437120, suggested_disk_percentage=0, default_disk_percentage=30, total_space=2065344266240, disk_size=139586437120) [2025-04-21 14:09:51.681444] INFO [SERVER] get_log_disk_info_in_config (ob_server_utils.cpp:88) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=15] get_log_disk_info_in_config(suggested_data_disk_size=139586437120, suggested_clog_disk_size=139586437120, suggested_data_disk_percentage=0, suggested_clog_disk_percentage=0, log_disk_size=139586437120, log_disk_percentage=0, total_log_disk_size=2065344266240) [2025-04-21 14:09:51.681468] INFO [CLOG] try_resize (ob_server_log_block_mgr.cpp:800) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=20] try_resize success(ret=0, log_disk_size=139586437120, total_log_disk_size=2065344266240, this={dir::"/home/oceanbase/tianxing/oceanbase/store/clog/log_pool", dir_fd:16, meta_fd:17, log_pool_meta:{curr_total_size:139586437120, next_total_size:139586437120, status:0}, min_block_id:8, max_block_id:2080, min_log_disk_size_for_all_tenants_:11811160064, is_inited:true}) [2025-04-21 14:09:51.681495] INFO [SERVER.OMT] run1 (ob_tenant_node_balancer.cpp:135) [619730][OmtNodeBalancer][T0][YB420B1D7AB6-00063343ABBEFD99-0-0] [lt=26] refresh tenant config(tenants=[1, 1001, 1002], ret=0) [2025-04-21 14:09:51.694986] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695136] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=49] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695336] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695543] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695613] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=22] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695802] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=32] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695789] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=77] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695855] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.695934] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=51] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.696079] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=53] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.696310] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=52] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:51.703908] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.718236] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=15] get number(ret=0, service_type_=0, range=1, base_id=1745215791717477000, start_id=1745215791717477000, end_id=1745215791717477001) [2025-04-21 14:09:51.718371] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=51] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=8417) [2025-04-21 14:09:51.728379] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:51.730374] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=84] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:51.746019] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1210, avg_group_log_size=121) [2025-04-21 14:09:51.746073] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1210) [2025-04-21 14:09:51.747578] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=88] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1383, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:51.747667] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=75] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=29, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:51.747732] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:51.747778] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1511, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:51.747808] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:51.757481] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE1B-0-0] [lt=41] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:51.762049] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDE1-0-0] [lt=49] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:51.763168] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=19] get number(ret=0, service_type_=0, range=1, base_id=1745215791762365000, start_id=1745215791762365000, end_id=1745215791762365001) [2025-04-21 14:09:51.776931] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=96] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:51.788196] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE19-0-0] [lt=42] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:51.791224] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0492-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.794078] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=39] get number(ret=0, service_type_=0, range=1, base_id=1745215791793906000, start_id=1745215791793906000, end_id=1745215791793906001) [2025-04-21 14:09:51.796762] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0496-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.797299] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=56] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:51.801714] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0497-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.801964] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE46-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.802002] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F0498-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.803676] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F049A-0-0] [lt=26][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.803783] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE48-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.803771] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD6-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.804077] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=82] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:51.804123] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=44] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:51.804154] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=30][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.813725] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [619980][T1_Flush][T1][Y0-0000000000000000-0-0] [lt=16] ====== traversal_flush timer task ====== [2025-04-21 14:09:51.813829] INFO [MDS] flush (mds_table_mgr.cpp:172) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDAB-0-0] [lt=38] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215805197259000, latest_log_ts:{val:1745215788616704001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:51.813956] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [619980][T1_Flush][T1][YB420B1D7AB6-00063343AE7EFDAB-0-0] [lt=119] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:51.819077] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:51.819140] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=50] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:51.820541] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=46] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:51.820609] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:51.822270] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=26] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:51.829487] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=43] gc stale ls task succ [2025-04-21 14:09:51.842036] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:51.843234] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:51.843283] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=40] temporary file module use no blocks [2025-04-21 14:09:51.843307] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=21] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:51.843333] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=23] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:51.843357] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254996393460, flush_io_finished_ret_:0, flush_io_finished_round_:183, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:51.846075] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:51.846132] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=2449, avg_group_log_size=222) [2025-04-21 14:09:51.846167] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=2449) [2025-04-21 14:09:51.846193] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT APPEND COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:51.847463] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=2449) [2025-04-21 14:09:51.857086] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=42][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:51.857223] WDIAG read_multi_row (ob_table_access_helper.h:238) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=43][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:51.858851] INFO delete_row (ob_table_access_helper.h:312) [619962][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=30] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215791857254) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215791857254) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:51.861680] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] ====== checkpoint timer task ====== [2025-04-21 14:09:51.862855] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=44] succ to get rec scn(*this={this:0x7f3c55e04030, ls_id:{id:1}, tenant_id:1, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176701154001, v:0}, max_applied_start_working_ts_:{val:1745215176701154001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215599877410, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1078}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:51.862922] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=66] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3cf3c080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3cf3c080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:51.862986] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=31] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c5573e510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215805197259000, latest_log_ts:{val:1745215788616704001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:51.863080] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=90] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c5573e1b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c55748390, memtable_head:0, memtable_tail:1, t3m:0x7f3c6e4cc030, tables:[0x7f3c3cf2c080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c5574a050, ls_tablet_svr:0x7f3c5573e190}, min_rec_scn={val:1745213981413072006, v:0}, ls_id_={id:1}) [2025-04-21 14:09:51.863123] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=36] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:51.863148] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=21] get rec log scn(service_type_=0, rec_log_ts={val:1745215788616704001, v:0}) [2025-04-21 14:09:51.863167] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=1, rec_log_ts={val:1745215615207349002, v:0}) [2025-04-21 14:09:51.863184] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=15] get rec log scn(service_type_=2, rec_log_ts={val:1745215615207349001, v:0}) [2025-04-21 14:09:51.863206] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=14] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:51.863236] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=24] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:51.863258] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745213981413072006, v:0}, checkpoint_scn_in_ls_meta={val:1745213981413072006, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:51.863287] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=19][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:51.863318] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=29] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:51.863337] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [619979][T1_TxCkpt][T1][Y0-0000000000000000-0-0] [lt=18] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:51.868305] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=39] clear dtl interm result cost(us)(clear_cost=3016, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:51.893100] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=73] ====== tenant freeze timer task ====== [2025-04-21 14:09:51.898104] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:51.898184] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=70] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.904065] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:51.910346] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDFC-0-0] [lt=35] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:51.916033] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=41] ls blacklist refresh finish(cost_time=8550) [2025-04-21 14:09:51.920730] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=35][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:51.920889] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [619843][T1_DupTbLease][T1][Y0-0000000000000000-0-0] [lt=46][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1 and flag like "%DUPLICATE%", tenant_id=1, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:51.928515] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=38] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:51.931023] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=100] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:51.940243] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=55] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=6400000, clean_num=200000) [2025-04-21 14:09:51.956411] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=43][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:26595926}], scn_array=[cnt:1, {val:1745215791917501000, v:0}], curr_size=588, accum_size=7238, time_cost=38592) [2025-04-21 14:09:51.958189] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:17430471}], scn_array=[cnt:1, {val:1745215791793906001, v:0}], curr_size=122, accum_size=122, time_cost=12002) [2025-04-21 14:09:51.958775] WDIAG [PALF] inner_append_log (palf_handle_impl.cpp:2226) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=26][errcode=-4389] write log cost too much time(ret=-4389, this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, lsn_array=[cnt:1, {lsn:9203708}], scn_array=[cnt:1, {val:1745215791793906001, v:0}], curr_size=122, accum_size=1710, time_cost=12560) [2025-04-21 14:09:51.961556] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3412, avg_group_log_size=379) [2025-04-21 14:09:51.967024] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=37] current monitor number(seq_=-1) [2025-04-21 14:09:51.977741] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=77] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=4024, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:51.977795] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:51.977849] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=12, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:51.977890] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=4252, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:51.977921] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:51.979498] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=25] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:51.979551] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:51.979687] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE1D-0-0] [lt=32] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:51.980309] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F049C-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.981870] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F049E-0-0] [lt=33][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:51.995657] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [619961][T1_LockWaitMgr][T1][Y0-0000000000000000-0-0] [lt=40] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:52.004115] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.022185] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1368, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:52.022229] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=42] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3413) [2025-04-21 14:09:52.022265] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=36, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:52.022296] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3413) [2025-04-21 14:09:52.022354] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:52.022381] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1504, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:52.022399] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1452, avg_log_submit_to_slide_time=1475) [2025-04-21 14:09:52.022432] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:52.022467] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=39] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3413, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:52.022568] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=22] [APPLY STAT CB APPEND COST TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=58, this=0x7f3c561f8280, extra_info="") [2025-04-21 14:09:52.022594] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=26] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=1813, this=0x7f3c561f84b0, extra_info="") [2025-04-21 14:09:52.022612] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=16] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c561f86e0, extra_info="") [2025-04-21 14:09:52.022629] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=15] [APPLY STAT CB EXECUTE TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=-473, this=0x7f3c561f8910, extra_info="") [2025-04-21 14:09:52.022646] INFO [LIB] stat (utility.h:1176) [619844][T1_ApplySrv0][T1][YB420B1D7AB6-00063343B4AF020D-0-0] [lt=16] [APPLY STAT CB TOTAL TIME](cur_stat_count=43, stat_interval=5000000, avg (count/cost)=1399, this=0x7f3c561f8b40, extra_info="") [2025-04-21 14:09:52.044463] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=42] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:52.047405] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1832) [2025-04-21 14:09:52.047465] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2436, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:52.047513] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:52.047599] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:52.047627] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2567, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:52.047654] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:52.055303] INFO [ARCHIVE] do_thread_task_ (ob_archive_fetcher.cpp:310) [620311][T1002_ArcFetche][T1002][YB420B1D7AB6-00063343AF2EFD86-0-0] [lt=83] ObArchiveFetcher is running(thread_index=0) [2025-04-21 14:09:52.063522] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=16] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:52.063618] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=56] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:52.063653] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=31] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=305, drift_size_=0, pre_drift_size=-2097152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:52.063714] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=26] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:52.063782] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:52.063805] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=21] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=32, drift_size_=0, pre_drift_size=-6291456, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:52.066334] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620312][T1002_ArcSender][T1002][YB420B1D7AB6-00063343AF3EFD86-0-0] [lt=40][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:52.070885] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A1-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.071401] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A2-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.083966] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=39] PNIO [ratelimit] time: 1745215792083962, bytes: 5485482, bw: 0.012700 MB/s, add_ts: 1007621, add_bytes: 13418 [2025-04-21 14:09:52.103024] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:52.103073] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.104183] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.117673] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00E0-0-0] [lt=35] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:52.117933] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=14, avg_log_batch_cnt=1, total_group_log_size=8416, avg_group_log_size=601) [2025-04-21 14:09:52.117972] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [PALF STAT APPEND COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:52.119464] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215791917501000, v:0}, new_max_version={val:1745215791917501000, v:0}, last_min_version={val:1745215791717477000, v:0}, last_max_version={val:1745215791717477000, v:0}, total_time_us=3101, delta_us=201961) [2025-04-21 14:09:52.119506] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215791917501000, v:0}, min_version={val:1745215791917501000, v:0}, max_version={val:1745215791917501000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:52.128660] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:52.140726] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=37] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:52.147502] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=2215) [2025-04-21 14:09:52.147559] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=2618, avg_log_submit_to_slide_time=2637) [2025-04-21 14:09:52.147605] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=3, avg_log_gen_to_submit_time=16, avg_log_submit_to_flush_time=2760, avg_log_submit_to_slide_time=2781) [2025-04-21 14:09:52.147644] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1720, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:52.161610] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=41] tx gc loop thread is running(MTL_ID()=1) [2025-04-21 14:09:52.161648] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=36] try gc retain ctx [2025-04-21 14:09:52.161662] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=13] try to retry start_working [2025-04-21 14:09:52.161700] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=10] finish update min start scn(max_decided_scn={val:1745215792019937000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215782011153001, v:0}, keep_alive_scn_:{val:1745215787015305001, v:0}, update_ts_:1745215792161151}) [2025-04-21 14:09:52.162616] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=29] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745213981413072006, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745215176656490001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215805197259000, latest_log_ts:{val:1745215788616704001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215615207349002, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215615207349001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c67ffc030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:52.167811] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=44] PNIO [ratelimit] time: 1745215792167807, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007618, add_bytes: 0 [2025-04-21 14:09:52.177371] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=9005) [2025-04-21 14:09:52.177449] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=27] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=9005) [2025-04-21 14:09:52.177505] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=15, avg_log_gen_to_freeze_time=98, avg_log_gen_to_submit_time=116, avg_log_submit_to_flush_time=3888, avg_log_submit_to_slide_time=3906) [2025-04-21 14:09:52.177583] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=9005, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:52.204252] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.216461] INFO [STORAGE.TRANS] generate_new_version (ob_tenant_weak_read_server_version_mgr.cpp:120) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] update tenant weak read server version(tenant_id=1001, server_version={version:{val:1745215792117274000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0, epoch_tstamp:1745215792216418}, version_delta=99184) [2025-04-21 14:09:52.218974] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=45] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1, server_version={version:{val:1745215792019937000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=199027, in_cluster_service=true, cluster_version={val:1745215791819638000, v:0}, min_cluster_version={val:1745215791819638000, v:0}, max_cluster_version={val:1745215791819638000, v:0}, get_cluster_version_err=0, cluster_version_delta=399326, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1709, succ_cluster_heartbeat_count=5, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215662469863000, v:0}, local_cluster_delta=129749101, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:52.225241] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=67] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:52.263653] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=45] gts statistics(tenant_id=1, gts_rpc_cnt=10, get_gts_cache_cnt=393, get_gts_with_stc_cnt=27, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=27, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:52.263696] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=40] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:52.304339] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.328811] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=42] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:52.342912] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=69] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:52.356146] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE31-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:52.356204] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE31-0-0] [lt=54] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:52.398286] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:52.398354] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=59] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.404422] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.412290] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=27] ====== check clog disk timer task ====== [2025-04-21 14:09:52.412346] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=49] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:52.421105] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=77] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3404) [2025-04-21 14:09:52.425186] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=44] gc stale ls task succ [2025-04-21 14:09:52.442402] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=385] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:52.443280] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:52.443345] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=42] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:52.443538] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:52.443728] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=33] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:52.443811] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:15, schedule:42, submit:7, rt:1200, total:1264) [2025-04-21 14:09:52.443895] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:52.443974] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=69] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8174, [delay/us]: prepare:15, schedule:42, submit:7, device:1200, total:1264) [2025-04-21 14:09:52.444048] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:52.444133] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:781, total:802) [2025-04-21 14:09:52.444210] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=17] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:52.444249] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:781, total:802) [2025-04-21 14:09:52.444322] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:52.444356] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:52.447887] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1842) [2025-04-21 14:09:52.458477] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40] ====== tenant freeze timer task ====== [2025-04-21 14:09:52.467044] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=45] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4151, offset=101907}, end_cursor:ObLogCursor{file_id=3, log_id=4152, offset=102213}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778ac050, len:493, log_data_len:306, seq:4151, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:52.467431] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE94-0-0] [lt=38] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:52.467522] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE94-0-0] [lt=45] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215792263035000, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215792263035000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:52.471299] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620231][T1002_TeRec][T1001][YB420B1D7AB6-00063343AEEEFE94-0-0] [lt=35] get number(ret=0, service_type_=0, range=1, base_id=1745215792470702000, start_id=1745215792470702000, end_id=1745215792470702001) [2025-04-21 14:09:52.474636] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=55] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4152, offset=102213}, end_cursor:ObLogCursor{file_id=3, log_id=4153, offset=102510}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778b0050, len:4283, log_data_len:297, seq:4152, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:52.474949] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE94-0-0] [lt=62] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:52.475001] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE94-0-0] [lt=35] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215792263035000, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215792263035000, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:52.475585] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=42] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.475763] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.475834] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.476158] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=47] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.479650] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:52.479696] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=38] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.490334] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=28] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:52.491552] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=37] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:52.491646] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=40] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215791239977000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:52.504490] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=58][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.529017] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=91] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:52.535605] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0214-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.538156] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0214-0-0] [lt=36][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254998088463, cache_obj->added_lc()=false, cache_obj->get_object_id()=776, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.543661] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=150] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:52.575162] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:09:52.575233] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=60] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:52.584244] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=53] gc stale ls task succ [2025-04-21 14:09:52.603180] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=19] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:52.603254] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620168][T1001_TabletShe][T1001][Y0-0000000000000000-0-0] [lt=57] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=37) [2025-04-21 14:09:52.603259] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:52.603317] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.604578] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.606211] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:52.610234] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:52.610289] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=53][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:52.612616] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:52.612663] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:52.646743] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:52.646807] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=52] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:52.648279] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=38] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1644, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:52.648782] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=21] ====== tenant freeze timer task ====== [2025-04-21 14:09:52.648843] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=52] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:52.648900] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=30] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:52.667610] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:22574895}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26602519}, readable_log_tail:{lsn:26602519}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40502249, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:52.667745] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=133] get_replay_process success(id={id:1}, submitted_log_size=22574895, unsubmitted_log_size=0, replayed_log_size=22574895, unreplayed_log_size=0) [2025-04-21 14:09:52.667792] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620133][T1001_ReplayPro][T1001][Y0-0000000000000000-0-0] [lt=23] dump tenant replay process(tenant_id=1001, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=21, replayed_log_size(MB)=21, last_submitted_log_size(MB)=21, last_replayed_log_size(MB)=21, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:52.690615] INFO [LIB] log_compress_loop_ (ob_log_compressor.cpp:410) [619493][SyslogCompress][T0][Y0-0000000000000000-0-0] [lt=53] log compressor cycles once. (ret=0, cost_time=0, compressed_file_count=0, deleted_file_count=0, disk_remaining_size=1585262538752, fast_delete_log_mode=false) [2025-04-21 14:09:52.694537] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695226] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695429] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695508] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=24] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695528] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=72] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695517] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=45] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695643] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=33] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695720] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=36] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.695825] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=34] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.696008] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=32] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.696216] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=48] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:52.703101] INFO [STORAGE] diagnose_for_suggestion (ob_compaction_suggestion.cpp:458) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] [COMPACTION DAG STATUS] (start_time=1745215782700356, end_time=1745215792703097, dag_status={}) [2025-04-21 14:09:52.703157] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=51] dump_dag_status(priority="PRIO_COMPACTION_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703191] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=33] dump_dag_status(priority="PRIO_HA_HIGH", limits=8, running_task=0, adaptive_task_limit=8, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703210] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=18] dump_dag_status(priority="PRIO_COMPACTION_MID", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703235] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(priority="PRIO_HA_MID", limits=5, running_task=0, adaptive_task_limit=5, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_COMPACTION_LOW", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703282] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_HA_LOW", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703305] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(priority="PRIO_DDL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703329] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(priority="PRIO_DDL_HIGH", limits=6, running_task=0, adaptive_task_limit=6, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703352] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:2838) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(priority="PRIO_TTL", limits=2, running_task=0, adaptive_task_limit=2, ready_dag_count=0, waiting_dag_count=0, rank_dag_count=0) [2025-04-21 14:09:52.703376] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:0, sys_task_type:3, dag_type_str:"MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703408] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=31] dump_dag_status(type={init_dag_prio:2, sys_task_type:5, dag_type_str:"MINOR_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703427] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"MAJOR_MERGE/MEDIUM_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703452] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_BATCH_EXECUTE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703476] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_PREPARE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703501] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_SCHEDULE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703525] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"CO_MERGE_FINISH", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703550] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:0, sys_task_type:4, dag_type_str:"TX_TABLE_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703576] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:0, sys_task_type:19, dag_type_str:"MDS_MINI_MERGE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703601] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"VERIFY_CKM", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703625] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:0, sys_task_type:23, dag_type_str:"BATCH_FREEZE", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703649] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"UPDATE_SKIP_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703673] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:4, sys_task_type:6, dag_type_str:"REFRESH_MAJOR", dag_module_str:"COMPACTION"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703701] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_COMPLEMENT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703726] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"UNIQUE_CHECK", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703751] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"SQL_BUILD_INDEX", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703775] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:7, sys_task_type:12, dag_type_str:"DDL_KV_MERGE", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703800] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:6, sys_task_type:2, dag_type_str:"DDL_DEL_LOB_META", dag_module_str:"DROP_VEC_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703825] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:6, sys_task_type:25, dag_type_str:"DDL_TABLET_SPLIT", dag_module_str:"DDL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703874] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703901] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATE_WARMUP", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703925] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"WAIT_DATA_READY", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703951] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_COMPLETE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.703976] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704001] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704027] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"SYS_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704052] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704078] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"DATA_TABLETS_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704103] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_GROUP_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704129] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"MIGRATION_FINISH", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704154] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"INITIAL_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"START_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704206] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"FINISH_PREPARE_MIGRATION", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704232] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:1, dag_type_str:"TABLET_CHECKE_CONVERT", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704258] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:3, sys_task_type:1, dag_type_str:"FAST_MIGRATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704284] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:1, dag_type_str:"VALIDATE", dag_module_str:"MIGRATE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704309] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"TABLET_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704335] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:16, dag_type_str:"FINISH_BACKFILL_TX", dag_module_str:"BACKFILL_TX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704360] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_META", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704386] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_PREPARE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704411] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_FINISH", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704438] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_DATA", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704463] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"PREFETCH_BACKUP_INFO", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704489] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_INDEX_REBUILD", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704516] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=27] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_COMPLEMENT_LOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704541] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"INITIAL_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704567] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"START_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704592] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"BACKUP_TABLET_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704618] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:8, dag_type_str:"FINISH_BACKUP_FUSE", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704643] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:10, dag_type_str:"BACKUP_BACKUPSET", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704651] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.704669] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:11, dag_type_str:"BACKUP_ARCHIVELOG", dag_module_str:"BACKUP"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704693] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=22] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704718] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704743] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"SYS_TABLETS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704768] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"DATA_TABLETS_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704798] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=29] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_GROUP_META_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704824] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_LS_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704850] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"INITIAL_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704875] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"START_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704900] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"FINISH_TABLET_GROUP_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704925] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:14, dag_type_str:"TABLET_RESTORE", dag_module_str:"RESTORE"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704950] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:5, sys_task_type:15, dag_type_str:"BACKUP_CLEAN", dag_module_str:"BACKUP_CLEAN"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.704975] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:3, sys_task_type:17, dag_type_str:"REMOVE_MEMBER", dag_module_str:"REMOVE_MEMBER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705018] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_BACKFILL_TX", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705046] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=44] dump_dag_status(type={init_dag_prio:1, sys_task_type:18, dag_type_str:"TRANSFER_REPLACE_TABLE", dag_module_str:"TRANSFER"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705072] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status(type={init_dag_prio:8, sys_task_type:20, dag_type_str:"TTL_DELTE_DAG", dag_module_str:"TTL"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705097] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:3, sys_task_type:21, dag_type_str:"TENANT_SNAPSHOT_CREATE", dag_module_str:"TSNAP_CR8"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705123] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=25] dump_dag_status(type={init_dag_prio:5, sys_task_type:22, dag_type_str:"TENANT_SNAPSHOT_GC", dag_module_str:"TSNAP_GC"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705151] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4301) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status(type={init_dag_prio:8, sys_task_type:24, dag_type_str:"VECTOR_INDEX_DAG", dag_module_str:"VECTOR_INDEX"}, dag_count=0, running_dag_count=0, added_dag_count=0, scheduled_dag_count=0, scheduled_task_count=0, scheduled_data_size=0) [2025-04-21 14:09:52.705179] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3612) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=26] dump_dag_status[DAG_NET](running_dag_net_map_size=0, blocking_dag_net_list_size=0, running_dag_net_list_size=0) [2025-04-21 14:09:52.705203] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=23] dump_dag_status[DAG_NET](type="DAG_NET_MIGRATION", dag_count=0) [2025-04-21 14:09:52.705227] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=24] dump_dag_status[DAG_NET](type="DAG_NET_PREPARE_MIGRATION", dag_count=0) [2025-04-21 14:09:52.705248] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_COMPLETE_MIGRATION", dag_count=0) [2025-04-21 14:09:52.705270] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER", dag_count=0) [2025-04-21 14:09:52.705291] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_BACKUP", dag_count=0) [2025-04-21 14:09:52.705311] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_RESTORE", dag_count=0) [2025-04-21 14:09:52.705332] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=19] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_BACKUP_CLEAN", dag_count=0) [2025-04-21 14:09:52.705353] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status[DAG_NET](type="DAG_NET_TYPE_CO_MAJOR", dag_count=0) [2025-04-21 14:09:52.705374] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:3615) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=20] dump_dag_status[DAG_NET](type="DAG_NET_TRANSFER_BACKFILL_TX", dag_count=0) [2025-04-21 14:09:52.705397] INFO [COMMON] dump_dag_status (ob_tenant_dag_scheduler.cpp:4315) [620117][T1001_DagSchedu][T1001][Y0-0000000000000000-0-0] [lt=21] dump_dag_status(dag_cnt=0, total_worker_cnt_=0, total_running_task_cnt=0, work_thread_num_=43, scheduled_task_cnt=0) [2025-04-21 14:09:52.714225] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=19] Garbage Collector is running(seq_=19, gc_interval=10000000) [2025-04-21 14:09:52.714303] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=40] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:52.714336] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=23] gc_check_member_list_ cost time(ret=0, time_us=70) [2025-04-21 14:09:52.714372] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=26] execute_gc cost time(ret=0, time_us=1) [2025-04-21 14:09:52.716241] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=25] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:52.716285] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=36] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:52.716305] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=18] execute_gc cost time(ret=0, time_us=22) [2025-04-21 14:09:52.716320] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=12] ObSafeDestroyHandler start process [2025-04-21 14:09:52.716336] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:133) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=14] ObSafeDestroyTaskQueue::loop begin(queue_.size()=0) [2025-04-21 14:09:52.716362] INFO [SERVER] loop (ob_safe_destroy_handler.cpp:140) [620138][T1001_GCCollect][T1001][Y0-0000000000000000-0-0] [lt=13] ObSafeDestroyTaskQueue::loop finish(ret=0, queue_.size()=0) [2025-04-21 14:09:52.718538] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7770) [2025-04-21 14:09:52.720598] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=43] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:52.721816] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:52.721914] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=38] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215785621567000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:52.729198] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=73] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:52.744360] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=82] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:52.746904] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1842, avg_group_log_size=184) [2025-04-21 14:09:52.747000] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=89] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1842) [2025-04-21 14:09:52.748752] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=61] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2536, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:52.748817] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=39, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:52.748847] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:52.748912] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2721, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:52.748948] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=26] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:52.758395] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620076][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=49] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:52.764496] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=27] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215792764475], gts:1745215792763850000, latest_srr:[mts=1745215792764475]}) [2025-04-21 14:09:52.766896] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0216-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.769441] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0216-0-0] [lt=46][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254998319747, cache_obj->added_lc()=false, cache_obj->get_object_id()=777, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.770930] WDIAG get_refactored (ob_hashtable.h:1120) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021A-0-0] [lt=45][errcode=-4201] hashtable not init [2025-04-21 14:09:52.770962] INFO [SQL.SESSION] get_cursor (ob_sql_session_info.cpp:1485) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021A-0-0] [lt=31] get cursor info failed(cursor_id=54, get_sessid()=3221487630) [2025-04-21 14:09:52.771106] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021B-0-0] [lt=22] get number(ret=0, service_type_=0, range=1, base_id=1745215792770312000, start_id=1745215792770312000, end_id=1745215792770312001) [2025-04-21 14:09:52.778563] INFO [LIB] stat (utility.h:1176) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=57] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:52.797438] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=47] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:52.804748] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=40][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.805153] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A4-0-0] [lt=23][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.805150] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE49-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.805725] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD7-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.807318] WDIAG begin (ob_hashtable.h:954) [620348][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B82EFE4F-0-0] [lt=27][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.807584] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A6-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.809443] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A8-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.822531] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:52.822698] INFO [LIB] stat (utility.h:1176) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=102] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:52.829629] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:52.837280] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:16864, max_lsn:26603696, max_scn:{val:1745215792777912000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:22573620}, reuse_lsn:{lsn:26603696}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:22574895}}, last_submit_lsn:{lsn:26603108}, last_submit_end_lsn:{lsn:26603696}, last_submit_log_id:16864, last_submit_log_pid:3, max_flushed_lsn:{lsn:26603108}, max_flushed_end_lsn:{lsn:26603696}, max_flushed_log_pid:3, committed_end_lsn:{lsn:26603696}, last_slide_log_id:16864, last_slide_scn:{val:1745215792777912000, v:0}, last_slide_lsn:{lsn:26603108}, last_slide_end_lsn:{lsn:26603696}, last_slide_log_pid:3, last_slide_log_accum_checksum:2316773831, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c4a4ca530}, [StateMgr]={this:0x7f3c4a4ce830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:16865, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215617617630, palf_role_change_cb:0x7f3c4a4d5270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_end_lsn:{lsn:22574895}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c4a4cbc70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:22573620}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/meta", dir_fd:138, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c4a4d09f8, flashback_version:0}, log_storage:{log_tail:{lsn:26603696}, readable_log_tail:{lsn:26603696}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40501072, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215617617308, this:0x7f3c4a4cef70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:22574895}, saved_end_lsn:{lsn:22574895}, last_submit_prepare_req_time_us:1745215617618129, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c4a4ce9b0}) [2025-04-21 14:09:52.837619] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=328] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215792780232, last_flushed_end_lsn:{lsn:26603696}}]) [2025-04-21 14:09:52.837648] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=24] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=16865, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215792780232, last_flushed_end_lsn:{lsn:26603696}}]) [2025-04-21 14:09:52.842228] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=38] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:52.846911] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=30] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:52.847010] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=80] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:52.847059] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:52.847098] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=35] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:52.849570] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:52.854002] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=60] new mysql sessid created(conn.sessid_=3221487850, support_ssl=false) [2025-04-21 14:09:52.854184] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=74] sm conn init succ(conn.sessid_=3221487850, sess.client_addr_="127.0.0.1:59854") [2025-04-21 14:09:52.854229] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] accept one succ(*s={this:0x7f3c20e68d70, session_id:3221487850, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:217}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854345] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=47] new mysql sessid created(conn.sessid_=3221487851, support_ssl=false) [2025-04-21 14:09:52.854368] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=101] new mysql sessid created(conn.sessid_=3221487852, support_ssl=false) [2025-04-21 14:09:52.854437] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=35] sm conn init succ(conn.sessid_=3221487852, sess.client_addr_="127.0.0.1:59862") [2025-04-21 14:09:52.854470] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=62] sm conn init succ(conn.sessid_=3221487851, sess.client_addr_="127.0.0.1:59866") [2025-04-21 14:09:52.854473] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=31] accept one succ(*s={this:0x7f3bc7c42d70, session_id:3221487852, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:219}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854511] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=34] accept one succ(*s={this:0x7f3bc7c42030, session_id:3221487851, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:218}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854526] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021D-0-0] [lt=43] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12276, add_timestamp:1745215792854493}) [2025-04-21 14:09:52.854567] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=42] new mysql sessid created(conn.sessid_=3221487853, support_ssl=false) [2025-04-21 14:09:52.854563] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE50-0-0] [lt=38] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=12276, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.854608] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] sm conn init succ(conn.sessid_=3221487853, sess.client_addr_="127.0.0.1:59872") [2025-04-21 14:09:52.854636] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=25] accept one succ(*s={this:0x7f3bc7c44030, session_id:3221487853, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:220}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854661] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=44] new mysql sessid created(conn.sessid_=3221487854, support_ssl=false) [2025-04-21 14:09:52.854722] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=61] new mysql sessid created(conn.sessid_=3221487855, support_ssl=false) [2025-04-21 14:09:52.854769] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=43] sm conn init succ(conn.sessid_=3221487854, sess.client_addr_="127.0.0.1:59894") [2025-04-21 14:09:52.854803] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=29] accept one succ(*s={this:0x7f3bc7c44d70, session_id:3221487854, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:221}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854841] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=71] sm conn init succ(conn.sessid_=3221487855, sess.client_addr_="127.0.0.1:59888") [2025-04-21 14:09:52.854877] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=27] accept one succ(*s={this:0x7f3c20f0a030, session_id:3221487855, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:222}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.854972] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=48] new mysql sessid created(conn.sessid_=3221487856, support_ssl=false) [2025-04-21 14:09:52.855051] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] sm conn init succ(conn.sessid_=3221487856, sess.client_addr_="127.0.0.1:59896") [2025-04-21 14:09:52.855073] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f3c20f0ad70, session_id:3221487856, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:223}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855204] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] new mysql sessid created(conn.sessid_=3221487857, support_ssl=false) [2025-04-21 14:09:52.855266] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=25] sm conn init succ(conn.sessid_=3221487857, sess.client_addr_="127.0.0.1:59900") [2025-04-21 14:09:52.855295] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=25] accept one succ(*s={this:0x7f3bc7c46030, session_id:3221487857, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:224}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855331] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] new mysql sessid created(conn.sessid_=3221487858, support_ssl=false) [2025-04-21 14:09:52.855370] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=14] sm conn init succ(conn.sessid_=3221487858, sess.client_addr_="127.0.0.1:59912") [2025-04-21 14:09:52.855397] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] accept one succ(*s={this:0x7f3bc7c46d70, session_id:3221487858, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:225}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855437] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE50-0-0] [lt=52] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12276, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792855387, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.855532] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221487859, support_ssl=false) [2025-04-21 14:09:52.855595] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=29] sm conn init succ(conn.sessid_=3221487859, sess.client_addr_="127.0.0.1:59914") [2025-04-21 14:09:52.855620] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] accept one succ(*s={this:0x7f3c20f0c030, session_id:3221487859, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:226}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855516] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE50-0-0] [lt=78] success to process renew task(task={tenant_id:1, table_id:12276, add_timestamp:1745215792854493}, locations=[{table_id:12276, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792855387, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.855684] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=28] new mysql sessid created(conn.sessid_=3221487860, support_ssl=false) [2025-04-21 14:09:52.855792] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=43] sm conn init succ(conn.sessid_=3221487860, sess.client_addr_="127.0.0.1:59924") [2025-04-21 14:09:52.855822] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=27] accept one succ(*s={this:0x7f3bc7c48030, session_id:3221487860, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:227}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855875] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=30] new mysql sessid created(conn.sessid_=3221487861, support_ssl=false) [2025-04-21 14:09:52.855888] INFO [RPC.OBMYSQL] sm_conn_build_handshake (obsm_conn_callback.cpp:121) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] new mysql sessid created(conn.sessid_=3221487862, support_ssl=false) [2025-04-21 14:09:52.855919] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] sm conn init succ(conn.sessid_=3221487861, sess.client_addr_="127.0.0.1:59938") [2025-04-21 14:09:52.855938] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=17] accept one succ(*s={this:0x7f3c20f0cd70, session_id:3221487861, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:228}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.855959] INFO [RPC.OBMYSQL] init (obsm_conn_callback.cpp:141) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] sm conn init succ(conn.sessid_=3221487862, sess.client_addr_="127.0.0.1:59948") [2025-04-21 14:09:52.855985] INFO [RPC.OBMYSQL] do_accept_one (ob_sql_nio.cpp:1082) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=19] accept one succ(*s={this:0x7f3bc7c48d70, session_id:3221487862, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:-1, sql_initiative_shutdown:false, reader:{fd:229}, err:0, last_decode_time:0, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:0, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.856152] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856171] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=19] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856243] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=29] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856273] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:291) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=27] mysql login queue(mysql_queue->queue_.size()=1) [2025-04-21 14:09:52.856219] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=38] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856337] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=33] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856377] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856415] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856442] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=21] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856448] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC0-0-0] [lt=48] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.856449] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC2-0-0] [lt=587] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.856492] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856525] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=27] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856572] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=22] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856604] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=25] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856639] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=24] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856615] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC5-0-0] [lt=34] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.856660] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856688] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856707] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=15] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856738] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=23] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856758] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619656][sql_nio1][T1][Y0-0000000000000000-0-0] [lt=17] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856780] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=37] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856830] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619658][sql_nio3][T1][Y0-0000000000000000-0-0] [lt=36] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856877] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=118] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856919] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=34] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856957] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.856979] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619657][sql_nio2][T1][Y0-0000000000000000-0-0] [lt=18] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.856986] INFO [SERVER] extract_user_tenant (obmp_connect.cpp:83) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=14] username and tenantname(user_name=ocp_monitor, tenant_name=) [2025-04-21 14:09:52.857034] INFO [SERVER] dispatch_req (ob_srv_deliver.cpp:286) [619655][sql_nio0][T1][Y0-0000000000000000-0-0] [lt=41] succeed to dispatch to tenant mysql queue(tenant_id=1) [2025-04-21 14:09:52.857598] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC0-0-0] [lt=35] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487850, proxy_sessid=0, client_sessid=3221487850, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.857636] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC2-0-0] [lt=37] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487862, proxy_sessid=0, client_sessid=3221487862, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.857730] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC1-0-0] [lt=52] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.857789] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC3-0-0] [lt=53] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.858175] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620057][T1_L0_G0][T1][YB420B1D7AB6-00063343B61EFD91-0-0] [lt=34] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11008, add_timestamp:1745215792858149}) [2025-04-21 14:09:52.858221] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD4-0-0] [lt=71] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12358, add_timestamp:1745215792858212}) [2025-04-21 14:09:52.858299] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD4-0-0] [lt=61] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12396, add_timestamp:1745215792858295}) [2025-04-21 14:09:52.858507] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC1-0-0] [lt=28] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487860, proxy_sessid=0, client_sessid=3221487860, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.858642] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC2-0-0] [lt=46] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.858755] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC5-0-0] [lt=41] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487861, proxy_sessid=0, client_sessid=3221487861, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.858899] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC3-0-0] [lt=39] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487859, proxy_sessid=0, client_sessid=3221487859, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.858932] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC6-0-0] [lt=72] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.859077] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC4-0-0] [lt=61] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.859333] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=41][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792859328}) [2025-04-21 14:09:52.859366] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=32][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792859328}) [2025-04-21 14:09:52.859360] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=31][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792859352}) [2025-04-21 14:09:52.859384] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=17][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856051, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.859425] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=30][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792859423}) [2025-04-21 14:09:52.859422] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC2-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487858, proxy_sessid=0, client_sessid=3221487858, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.859441] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=15][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792859423}) [2025-04-21 14:09:52.859412] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=51][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792859352}) [2025-04-21 14:09:52.859455] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021E-0-0] [lt=14][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856174, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.859472] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=58][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856051, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.859545] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC3-0-0] [lt=31] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.859584] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=82][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792859576}) [2025-04-21 14:09:52.859613] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=28][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792859576}) [2025-04-21 14:09:52.859632] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9D-0-0] [lt=19][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856174, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.859788] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD4-0-0] [lt=23] get_stable_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:52.859899] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620043][T1_L0_G0][T1001][YB420B1D7AB6-00063343B5BEFDD4-0-0] [lt=32] get_stable_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:52.859943] INFO [PALF] get_stable_disk_usage (palf_env_impl.cpp:922) [620043][T1_L0_G0][T1002][YB420B1D7AB6-00063343B5BEFDD4-0-0] [lt=22] get_stable_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:52.860034] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD95-0-0] [lt=11] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11017, add_timestamp:1745215792860029}) [2025-04-21 14:09:52.860141] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC4-0-0] [lt=25] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487854, proxy_sessid=0, client_sessid=3221487854, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.860177] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE51-0-0] [lt=148] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.860293] INFO load_privilege_info (obmp_connect.cpp:582) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC5-0-0] [lt=44] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.860275] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC6-0-0] [lt=30] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487857, proxy_sessid=0, client_sessid=3221487857, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.860341] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC3-0-0] [lt=23] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487856, proxy_sessid=0, client_sessid=3221487856, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.860415] INFO load_privilege_info (obmp_connect.cpp:582) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC7-0-0] [lt=44] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.860449] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC4-0-0] [lt=33] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.861247] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC4-0-0] [lt=22] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487851, proxy_sessid=0, client_sessid=3221487851, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.861353] INFO load_privilege_info (obmp_connect.cpp:582) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC5-0-0] [lt=38] no tenant name set, use default tenant name(tenant_name=sys) [2025-04-21 14:09:52.861374] INFO [SERVER] process (obmp_connect.cpp:523) [619967][T1_MysqlQueueTh][T1][Y0-00063343AD1EFDC5-0-0] [lt=24] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487855, proxy_sessid=0, client_sessid=3221487855, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.861823] INFO [SERVER] process (obmp_connect.cpp:523) [619969][T1_MysqlQueueTh][T1][Y0-00063343AFEEFDC7-0-0] [lt=39] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487853, proxy_sessid=0, client_sessid=3221487853, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.862138] INFO [SERVER] process (obmp_connect.cpp:523) [619968][T1_MysqlQueueTh][T1][Y0-00063343AE8EFDC5-0-0] [lt=16] MySQL LOGIN(direct_client_ip="127.0.0.1", client_ip=127.0.0.1, tenant_name=sys, tenant_id=1, user_name=ocp_monitor, host_name=%, sessid=3221487852, proxy_sessid=0, client_sessid=3221487852, from_proxy=false, from_java_client=false, from_oci_client=false, from_jdbc_client=false, capability=762509, proxy_capability=0, use_ssl=false, c/s protocol="OB_MYSQL_CS_TYPE", autocommit=true, proc_ret=0, ret=0, conn->client_type_=3, conn->client_version_=0) [2025-04-21 14:09:52.862383] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=50][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792862379}) [2025-04-21 14:09:52.862374] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAE-0-0] [lt=13][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215792862369}) [2025-04-21 14:09:52.862418] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=34][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12358, add_timestamp:1745215792862379}) [2025-04-21 14:09:52.862419] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAE-0-0] [lt=43][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:11017, add_timestamp:1745215792862369}) [2025-04-21 14:09:52.862433] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=14][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12358, vtable_locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856051, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.862443] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAE-0-0] [lt=22][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=11017, vtable_locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777860763, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.862467] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=23][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792862466}) [2025-04-21 14:09:52.862481] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=13][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:12396, add_timestamp:1745215792862466}) [2025-04-21 14:09:52.862493] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=11][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=12396, vtable_locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777856174, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.862518] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620046][T1_L0_G0][T1][YB420B1D7AB6-00063343B6AEFD9B-0-0] [lt=16] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:10008, add_timestamp:1745215792862515}) [2025-04-21 14:09:52.862590] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD92-0-0] [lt=994] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11021, add_timestamp:1745215792862567}) [2025-04-21 14:09:52.864343] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE51-0-0] [lt=40] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11008, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864297, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.864400] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE51-0-0] [lt=52] success to process renew task(task={tenant_id:1, table_id:11008, add_timestamp:1745215792858149}, locations=[{table_id:11008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864297, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.864464] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE52-0-0] [lt=28] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12358, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864453, sql_renew_time:1745215792864453, is_mark_fail:false}]) [2025-04-21 14:09:52.864485] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE52-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:12358, add_timestamp:1745215792858212}, locations=[{table_id:12358, partition_id:12358, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864453, sql_renew_time:1745215792864453, is_mark_fail:false}]) [2025-04-21 14:09:52.864524] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE53-0-0] [lt=19] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12396, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864512, sql_renew_time:1745215792864512, is_mark_fail:false}]) [2025-04-21 14:09:52.864545] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE53-0-0] [lt=21] success to process renew task(task={tenant_id:1, table_id:12396, add_timestamp:1745215792858295}, locations=[{table_id:12396, partition_id:12396, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792864512, sql_renew_time:1745215792864512, is_mark_fail:false}]) [2025-04-21 14:09:52.864575] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE54-0-0] [lt=20] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11017, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.865168] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=12][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42030, session_id:3221487851, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215792860962, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.865252] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=67] kill and revert session(conn.sessid_=3221487851, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.865288] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=32] sock ref clean, do destroy(*s={this:0x7f3bc7c42030, session_id:3221487851, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:218}, err:5, last_decode_time:1745215792860962, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:239, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.865346] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=35] unlock session of tenant(conn.sessid_=3221487851, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.865382] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=33] connection close(sessid=3221487851, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDAD-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:134, rec_:134, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:7}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:8}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:52.865441] WDIAG [SHARE.LOCATION] add_update_task (ob_vtable_location_service.cpp:388) [620071][T1_L0_G0][T1][YB420B1D7AB6-00063343B8AEFD8A-0-0] [lt=45][errcode=-4023] fail to add task(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215792865433}) [2025-04-21 14:09:52.865434] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=15][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0c030, session_id:3221487859, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215792858821, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.865492] WDIAG [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:444) [620071][T1_L0_G0][T1][YB420B1D7AB6-00063343B8AEFD8A-0-0] [lt=49][errcode=-4023] add location update task failed(ret=-4023, ret="OB_EAGAIN", task={tenant_id:1, table_id:10008, add_timestamp:1745215792865433}) [2025-04-21 14:09:52.865477] INFO [SERVER] run (obmp_disconnect.cpp:82) [620049][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=45] free session successfully(sessid=3221487851) [2025-04-21 14:09:52.865508] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=61] kill and revert session(conn.sessid_=3221487859, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.865511] WDIAG [SHARE.LOCATION] vtable_get (ob_vtable_location_service.cpp:156) [620071][T1_L0_G0][T1][YB420B1D7AB6-00063343B8AEFD8A-0-0] [lt=17][errcode=0] add location update task failed(temp_ret=-4023, temp_ret="OB_EAGAIN", tenant_id=1, table_id=10008, vtable_locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215777866122, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.865528] INFO [SERVER] run (obmp_disconnect.cpp:89) [620049][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=49] mark session id unused(sessid=3221487851) [2025-04-21 14:09:52.865558] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] sock ref clean, do destroy(*s={this:0x7f3c20f0c030, session_id:3221487859, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:226}, err:5, last_decode_time:1745215792858821, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:471, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.865601] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] unlock session of tenant(conn.sessid_=3221487859, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.865606] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021F-0-0] [lt=30] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12217, add_timestamp:1745215792865597}) [2025-04-21 14:09:52.865619] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=16] connection close(sessid=3221487859, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B87EFD8E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:366, rec_:366, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:7, seq_:9}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:1, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:52.865682] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021F-0-0] [lt=53] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12142, add_timestamp:1745215792865679}) [2025-04-21 14:09:52.865728] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021F-0-0] [lt=33] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11035, add_timestamp:1745215792865725}) [2025-04-21 14:09:52.865788] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021F-0-0] [lt=22] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12072, add_timestamp:1745215792865759}) [2025-04-21 14:09:52.865825] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF021F-0-0] [lt=23] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:12068, add_timestamp:1745215792865821}) [2025-04-21 14:09:52.865834] INFO [SERVER] run (obmp_disconnect.cpp:82) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=13] free session successfully(sessid=3221487859) [2025-04-21 14:09:52.865870] INFO [SERVER] run (obmp_disconnect.cpp:89) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=35] mark session id unused(sessid=3221487859) [2025-04-21 14:09:52.865884] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=86][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20e68d70, session_id:3221487850, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215792857754, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.865915] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=25] kill and revert session(conn.sessid_=3221487850, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.865987] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] sock ref clean, do destroy(*s={this:0x7f3c20e68d70, session_id:3221487850, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:217}, err:5, last_decode_time:1745215792857754, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:236, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.866027] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=26] unlock session of tenant(conn.sessid_=3221487850, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.866041] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487850, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B61EFD91-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:131, rec_:131, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:25, seq_:31}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:32}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:52.866065] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=74][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c48d70, session_id:3221487862, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:229}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:667, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.866124] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=50] kill and revert session(conn.sessid_=3221487862, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.866131] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=34][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0cd70, session_id:3221487861, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:228}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.866158] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=22] kill and revert session(conn.sessid_=3221487861, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.866197] INFO [SERVER] run (obmp_disconnect.cpp:82) [620051][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487850) [2025-04-21 14:09:52.866248] INFO [SERVER] run (obmp_disconnect.cpp:89) [620051][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=48] mark session id unused(sessid=3221487850) [2025-04-21 14:09:52.866373] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=19][errcode=0] server close connection(sessid=3221487861, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.866396] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=33][errcode=0] server close connection(sessid=3221487862, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.866421] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=44] quit [2025-04-21 14:09:52.866428] INFO [SERVER] process (obmp_quit.h:56) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=29] quit [2025-04-21 14:09:52.866428] INFO [SHARE.LOCATION] vtable_nonblock_renew (ob_vtable_location_service.cpp:446) [620051][T1_L0_G0][T1][YB420B1D7AB6-00063343B63EFD92-0-0] [lt=18] add_update_task succeed(ret=0, ret="OB_SUCCESS", task={tenant_id:1, table_id:11003, add_timestamp:1745215792866423}) [2025-04-21 14:09:52.866442] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=19][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.866445] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=15][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.866464] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=17][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.866464] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=20][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.866482] WDIAG [SERVER] response (obmp_base.cpp:87) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.866482] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=17][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.866500] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.866500] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=17][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.866523] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=19][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866543] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD5-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866523] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=18][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866561] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866562] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620050][T1_L0_G0][T1][YB420B1D7AB6-00063343B8FEFD8B-0-0] [lt=38][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866580] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620050][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.866889] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=15] can close safely, do destroy(*s={this:0x7f3c20f0cd70, session_id:3221487861, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:228}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.866935] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36] unlock session of tenant(conn.sessid_=3221487861, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.866950] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487861, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF021E-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.866991] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=36][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0ad70, session_id:3221487856, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.867013] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=18] kill and revert session(conn.sessid_=3221487856, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.867037] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=17] free session successfully(sessid=3221487861) [2025-04-21 14:09:52.867070] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=32] mark session id unused(sessid=3221487861) [2025-04-21 14:09:52.867072] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:976) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=12] sock ref clean, do destroy(*s={this:0x7f3c20f0ad70, session_id:3221487856, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:false, reader:{fd:223}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:203, pending_flag:0, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.867104] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=21] unlock session of tenant(conn.sessid_=3221487856, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.867117] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619656][sql_nio1][T0][Y0-0000000000000000-0-0] [lt=13] connection close(sessid=3221487856, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B63EFD92-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:7, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:98, rec_:98, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:10}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:11}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}], disconnect_state=4) [2025-04-21 14:09:52.867204] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=16] free session successfully(sessid=3221487856) [2025-04-21 14:09:52.867228] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=20] mark session id unused(sessid=3221487856) [2025-04-21 14:09:52.867226] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE54-0-0] [lt=18] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11017, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792867199, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.867268] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE54-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:11017, add_timestamp:1745215792860029}, locations=[{table_id:11017, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792867199, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.867313] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE55-0-0] [lt=28] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=10008, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.867806] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE55-0-0] [lt=35] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=10008, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792867793, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.867856] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE55-0-0] [lt=49] success to process renew task(task={tenant_id:1, table_id:10008, add_timestamp:1745215792862515}, locations=[{table_id:10008, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792867793, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.867885] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE56-0-0] [lt=18] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11021, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.867875] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c48030, session_id:3221487860, trace_id:YB420B1D7AB6-00063343B5BEFDD6-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:227}, err:5, last_decode_time:1745215792867447, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:738, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.867903] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=42][errcode=0] server close connection(sessid=3221487860, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.867933] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=28] quit [2025-04-21 14:09:52.867939] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=56] kill and revert session(conn.sessid_=3221487860, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.867947] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=12][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.867961] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=12][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.867974] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=12][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.867976] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44d70, session_id:3221487854, trace_id:YB420B1D7AB6-00063343B5DEFD9E-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:221}, err:5, last_decode_time:1745215792867447, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:539, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.867989] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=15][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.868002] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=23] kill and revert session(conn.sessid_=3221487854, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.868004] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868020] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD6-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868032] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868006] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=22][errcode=0] server close connection(sessid=3221487854, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.868032] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] can close safely, do destroy(*s={this:0x7f3bc7c48030, session_id:3221487860, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:227}, err:5, last_decode_time:1745215792867447, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:743, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.868056] INFO [SERVER] process (obmp_quit.h:56) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=46] quit [2025-04-21 14:09:52.868067] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487860, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.868073] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=16][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.868088] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=14][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.868111] WDIAG [SERVER] response (obmp_base.cpp:87) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=21][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.868084] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=15] connection close(sessid=3221487860, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5DEFD9D-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:633, rec_:633, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:6, seq_:8}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:11}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:12}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.868123] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=11][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.868139] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868134] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=48] can close safely, do destroy(*s={this:0x7f3bc7c44d70, session_id:3221487854, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:221}, err:5, last_decode_time:1745215792867447, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:544, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.868152] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620045][T1_L0_G0][T1][YB420B1D7AB6-00063343B5DEFD9E-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868152] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12] free session successfully(sessid=3221487860) [2025-04-21 14:09:52.868165] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.868164] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=18] unlock session of tenant(conn.sessid_=3221487854, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.868175] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] mark session id unused(sessid=3221487860) [2025-04-21 14:09:52.868185] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487854, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B6AEFD9B-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:434, rec_:434, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.868269] INFO [SERVER] run (obmp_disconnect.cpp:82) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=13] free session successfully(sessid=3221487854) [2025-04-21 14:09:52.868294] INFO [SERVER] run (obmp_disconnect.cpp:89) [620045][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] mark session id unused(sessid=3221487854) [2025-04-21 14:09:52.869769] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE56-0-0] [lt=13] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11021, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869753, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.869810] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE56-0-0] [lt=41] success to process renew task(task={tenant_id:1, table_id:11021, add_timestamp:1745215792862567}, locations=[{table_id:11021, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869753, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.869850] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE57-0-0] [lt=20] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12217, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869841, sql_renew_time:1745215792869841, is_mark_fail:false}]) [2025-04-21 14:09:52.869874] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE57-0-0] [lt=24] success to process renew task(task={tenant_id:1, table_id:12217, add_timestamp:1745215792865597}, locations=[{table_id:12217, partition_id:12217, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869841, sql_renew_time:1745215792869841, is_mark_fail:false}]) [2025-04-21 14:09:52.869909] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE58-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12142, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869903, sql_renew_time:1745215792869903, is_mark_fail:false}]) [2025-04-21 14:09:52.869933] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE58-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12142, add_timestamp:1745215792865679}, locations=[{table_id:12142, partition_id:12142, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869903, sql_renew_time:1745215792869903, is_mark_fail:false}]) [2025-04-21 14:09:52.869969] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE59-0-0] [lt=22] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11035, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869962, sql_renew_time:1745215792869962, is_mark_fail:false}]) [2025-04-21 14:09:52.869995] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE59-0-0] [lt=26] success to process renew task(task={tenant_id:1, table_id:11035, add_timestamp:1745215792865725}, locations=[{table_id:11035, partition_id:11035, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792869962, sql_renew_time:1745215792869962, is_mark_fail:false}]) [2025-04-21 14:09:52.870034] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5A-0-0] [lt=25] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12072, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792870027, sql_renew_time:1745215792870027, is_mark_fail:false}]) [2025-04-21 14:09:52.870059] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5A-0-0] [lt=25] success to process renew task(task={tenant_id:1, table_id:12072, add_timestamp:1745215792865759}, locations=[{table_id:12072, partition_id:12072, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792870027, sql_renew_time:1745215792870027, is_mark_fail:false}]) [2025-04-21 14:09:52.870088] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5B-0-0] [lt=16] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=12068, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792870081, sql_renew_time:1745215792870081, is_mark_fail:false}]) [2025-04-21 14:09:52.870113] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5B-0-0] [lt=23] success to process renew task(task={tenant_id:1, table_id:12068, add_timestamp:1745215792865821}, locations=[{table_id:12068, partition_id:12068, partition_cnt:0, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792870081, sql_renew_time:1745215792870081, is_mark_fail:false}]) [2025-04-21 14:09:52.870155] INFO [SHARE.LOCATION] fetch_vtable_location_ (ob_vtable_location_service.cpp:281) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5C-0-0] [lt=29] fetch virtual table location with tenant(rpc tenant=0, tenant_id=1, table_id=11003, vtable_type={tenant_id:1, type:4}) [2025-04-21 14:09:52.870867] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620044][T1_L0_G0][T1][YB420B1D7AB6-00063343B62EFDAE-0-0] [lt=36][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:52.870962] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_stat.cpp:300) [620048][T1_L0_G0][T1][YB420B1D7AB6-00063343B70EFD92-0-0] [lt=42][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:52.871073] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=29][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3c20f0a030, session_id:3221487855, trace_id:YB420B1D7AB6-00063343B5BEFDD7-0-0, sql_handling_stage:5, sql_initiative_shutdown:false, reader:{fd:222}, err:5, last_decode_time:1745215792870657, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:562, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.871102] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=35][errcode=0] server close connection(sessid=3221487855, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.871124] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=42] kill and revert session(conn.sessid_=3221487855, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.871146] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=40] quit [2025-04-21 14:09:52.871173] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=24][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.871194] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=19][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.871208] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=13][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.871221] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=12][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.871236] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=13][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.871256] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD7-0-0] [lt=15][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.871268] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=12][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.871574] INFO [SHARE.LOCATION] renew_vtable_location_ (ob_vtable_location_service.cpp:207) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5C-0-0] [lt=34] renew vtable location success(ret=0, ret="OB_SUCCESS", tenant_id=1, table_id=11003, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792871562, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.871613] INFO [SHARE.LOCATION] batch_process_tasks (ob_vtable_location_service.cpp:414) [619597][VTblLocAsyncUp0][T0][YB420B1D7AB6-00063343B6DEFE5C-0-0] [lt=38] success to process renew task(task={tenant_id:1, table_id:11003, add_timestamp:1745215792866423}, locations=[{table_id:11003, partition_id:0, partition_cnt:1, replica_locations:[{server:"11.29.122.182:2882", role:1, sql_port:2881, replica_type:0, reserved:0, property:{memstore_percent_:100}}], renew_time:1745215792871562, sql_renew_time:0, is_mark_fail:false}]) [2025-04-21 14:09:52.871889] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=51][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c42d70, session_id:3221487852, trace_id:YB420B1D7AB6-00063343B5BEFDD8-0-0, sql_handling_stage:10, sql_initiative_shutdown:false, reader:{fd:219}, err:5, last_decode_time:1745215792871727, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:793, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.871914] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=15][errcode=0] server close connection(sessid=3221487852, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.871936] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=41] kill and revert session(conn.sessid_=3221487852, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.871941] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=26] quit [2025-04-21 14:09:52.871955] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=13][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.871967] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=11][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.871979] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=10][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.871989] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=10][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.872002] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.872013] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD8-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.872024] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.872171] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=16] can close safely, do destroy(*s={this:0x7f3bc7c42d70, session_id:3221487852, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:219}, err:5, last_decode_time:1745215792871727, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:798, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.872191] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD9-0-0] [lt=11][errcode=0] server close connection(sessid=3221487857, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.872221] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDD9-0-0] [lt=28] quit [2025-04-21 14:09:52.872223] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=37] unlock session of tenant(conn.sessid_=3221487852, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.872245] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487852, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B70EFD92-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:688, rec_:688, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:222, seq_:228}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:229}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.872297] WDIAG [RPC.OBMYSQL] push_close_req (ob_sql_nio.cpp:878) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=47][errcode=-4015] close sql sock by user req(*s={this:0x7f3bc7c46030, session_id:3221487857, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215792871727, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.872328] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=25] kill and revert session(conn.sessid_=3221487857, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.872344] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=45] free session successfully(sessid=3221487852) [2025-04-21 14:09:52.872386] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=40] mark session id unused(sessid=3221487852) [2025-04-21 14:09:52.872390] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=20] can close safely, do destroy(*s={this:0x7f3bc7c46030, session_id:3221487857, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:224}, err:5, last_decode_time:1745215792871727, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:351, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.872424] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=25] unlock session of tenant(conn.sessid_=3221487857, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.872410] WDIAG [SERVER] inner_get_next_row (ob_all_virtual_sys_event.cpp:102) [620047][T1_L0_G0][T1][YB420B1D7AB6-00063343B88EFD95-0-0] [lt=37][errcode=-4008] execute fail(ret=-4008) [2025-04-21 14:09:52.872445] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=19] connection close(sessid=3221487857, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B62EFDAE-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:241, rec_:241, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.872489] INFO [SERVER] run (obmp_disconnect.cpp:82) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=26] free session successfully(sessid=3221487857) [2025-04-21 14:09:52.872524] INFO [SERVER] run (obmp_disconnect.cpp:89) [620044][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=34] mark session id unused(sessid=3221487857) [2025-04-21 14:09:52.873106] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=42][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c46d70, session_id:3221487858, trace_id:YB420B1D7AB6-00063343B5BEFDDA-0-0, sql_handling_stage:3, sql_initiative_shutdown:false, reader:{fd:225}, err:5, last_decode_time:1745215792872984, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:654, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.873143] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=32] kill and revert session(conn.sessid_=3221487858, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.873133] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=20][errcode=0] server close connection(sessid=3221487858, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.873180] INFO [SERVER] process (obmp_quit.h:56) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=46] quit [2025-04-21 14:09:52.873195] WDIAG [RPC.OBMYSQL] async_write_data (ob_sql_sock_session.cpp:163) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=13][errcode=-4009] sock has error(ret=-4009) [2025-04-21 14:09:52.873209] WDIAG [SERVER] flush_buffer (obmp_packet_sender.cpp:1071) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=12][errcode=-4009] write response fail(ret=-4009) [2025-04-21 14:09:52.873221] WDIAG [SERVER] response (obmp_base.cpp:87) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=11][errcode=-4009] failed to flush_buffer(ret=-4009) [2025-04-21 14:09:52.873232] WDIAG [RPC.FRAME] run (ob_sql_processor.cpp:50) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=10][errcode=-4009] response rpc result fail(ret=-4009, tmp_ret=-4009) [2025-04-21 14:09:52.873246] WDIAG [SERVER.OMT] process_one (ob_worker_processor.cpp:89) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.873258] WDIAG [SERVER.OMT] process (ob_worker_processor.cpp:157) [620043][T1_L0_G0][T1][YB420B1D7AB6-00063343B5BEFDDA-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.873269] WDIAG [SERVER.OMT] process_request (ob_th_worker.cpp:250) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=11][errcode=-4009] process request fail(ret=-4009) [2025-04-21 14:09:52.898467] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:52.898530] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.904831] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:52.906738] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=105] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:52.906868] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=23] can close safely, do destroy(*s={this:0x7f3bc7c48d70, session_id:3221487862, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:229}, err:5, last_decode_time:1745215792865279, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:672, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.906953] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=61] unlock session of tenant(conn.sessid_=3221487862, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.906986] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=31] connection close(sessid=3221487862, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B5BEFDD4-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:562, rec_:562, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:9}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:10}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.907035] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=23] free session successfully(sessid=3221487862) [2025-04-21 14:09:52.907073] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=36] mark session id unused(sessid=3221487862) [2025-04-21 14:09:52.909039] WDIAG [SERVER] disconnect (obmp_packet_sender.cpp:868) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0220-0-0] [lt=19][errcode=0] server close connection(sessid=3221487853, proxy_sessid=0, stack="0x7bad295 0xecda6c0 0xeca1c99 0xe644eb1 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:52.909076] INFO [SERVER] process (obmp_quit.h:56) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0220-0-0] [lt=33] quit [2025-04-21 14:09:52.909094] WDIAG [RPC.OBMYSQL] handle_sock_event (ob_sql_nio.cpp:1001) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=60][errcode=0] socket closed, it maybe disconnected by the client or by observer actively(mask=8197, *s={this:0x7f3bc7c44030, session_id:3221487853, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:220}, err:5, last_decode_time:1745215792908566, pending_write_task:{buf:0x7f3bc9852110, sz:0}, need_epoll_trigger_write:false, consume_size:229, pending_flag:1, may_handling_flag:true, handler_close_flag:false}) [2025-04-21 14:09:52.909153] INFO [RPC.OBMYSQL] on_disconnect (obsm_conn_callback.cpp:268) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=49] kill and revert session(conn.sessid_=3221487853, proxy_sessid=0, server_id=1, ret=0) [2025-04-21 14:09:52.909183] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=27] can close safely, do destroy(*s={this:0x7f3bc7c44030, session_id:3221487853, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:220}, err:5, last_decode_time:1745215792908566, pending_write_task:{buf:0x7f3bc9852110, sz:0}, need_epoll_trigger_write:false, consume_size:229, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.909225] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=30] unlock session of tenant(conn.sessid_=3221487853, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.909248] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619657][sql_nio2][T0][Y0-0000000000000000-0-0] [lt=21] connection close(sessid=3221487853, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B4AF021F-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:119, rec_:119, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:2, seq_:4}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:5}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:3, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.909279] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=15] free session successfully(sessid=3221487853) [2025-04-21 14:09:52.909307] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=25] mark session id unused(sessid=3221487853) [2025-04-21 14:09:52.929330] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=43] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:52.937332] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620088][T1001_LogLoop][T1001][Y0-0000000000000000-0-0] [lt=50] LogLoopThread round_cost_time(us)(round_cost_time=463) [2025-04-21 14:09:52.944967] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=92] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:52.962319] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=112] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=3963, avg_group_log_size=396) [2025-04-21 14:09:52.967168] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=39] current monitor number(seq_=-1) [2025-04-21 14:09:52.979508] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=38] [PALF STAT WRITE LOG COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1484, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:52.979580] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=44, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:52.979668] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=15, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:52.979725] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=56] [PALF STAT LOG LIFE TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=1634, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:52.979771] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT FLUSH CB COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=57, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:52.979866] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=23] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=10398720) [2025-04-21 14:09:52.979919] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:52.982799] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=13] can close safely, do destroy(*s={this:0x7f3bc7c46d70, session_id:3221487858, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:225}, err:5, last_decode_time:1745215792872984, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:659, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:52.982879] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=60] unlock session of tenant(conn.sessid_=3221487858, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:52.982908] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619655][sql_nio0][T0][Y0-0000000000000000-0-0] [lt=26] connection close(sessid=3221487858, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B88EFD95-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:549, rec_:549, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:4, seq_:6}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:7}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:15, seq_:22}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:23}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:52.982995] INFO [SERVER] run (obmp_disconnect.cpp:82) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=22] free session successfully(sessid=3221487858) [2025-04-21 14:09:52.983036] INFO [SERVER] run (obmp_disconnect.cpp:89) [620042][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=38] mark session id unused(sessid=3221487858) [2025-04-21 14:09:52.983148] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04A9-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:52.985159] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04AB-0-0] [lt=40][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.004899] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.009919] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [620172][T1001_ArcSender][T1001][YB420B1D7AB6-00063343AD6EFD86-0-0] [lt=40][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:53.013856] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [619792][T1_PalfGC][T1][Y0-0000000000000000-0-0] [lt=64] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5120, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):126, sequence:1}) [2025-04-21 14:09:53.014008] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=46] BlockGCTimerTask success(ret=0, cost_time_us=11, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:53.017118] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [619971][T1_LCLSender][T1][Y0-0000000000000000-0-0] [lt=53] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c6c1ee2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:53.021727] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=25] get number(ret=0, service_type_=0, range=1, base_id=1745215793021312000, start_id=1745215793021312000, end_id=1745215793021312001) [2025-04-21 14:09:53.024035] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1609, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:53.024085] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3963) [2025-04-21 14:09:53.024128] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:53.024165] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3963) [2025-04-21 14:09:53.024225] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=41] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:53.024250] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1756, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:53.024271] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=1695, avg_log_submit_to_slide_time=1720) [2025-04-21 14:09:53.024306] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=53, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:53.024410] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=31] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3963, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:53.024546] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=44] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:53.036878] INFO [SQL.EXE] run2 (ob_maintain_dependency_info_task.cpp:228) [619580][MaintainDepInfo][T0][Y0-0000000000000000-0-0] [lt=44] [ASYNC TASK QUEUE](queue_.size()=0, sys_view_consistent_.size()=455) [2025-04-21 14:09:53.042034] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=29] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:53.042087] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=52] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:53.042101] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD99-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:53.042167] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619546][SerScheQueue0][T0][YB420B1D7AB6-00063343B2CEFD99-0-0] [lt=59] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:53.044598] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=40] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:53.049338] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:53.049434] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1724, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:53.049546] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=103] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=34, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:53.049655] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=27] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:53.049696] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1865, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:53.049719] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=16] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:53.075038] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04AE-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.075685] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04AF-0-0] [lt=52][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.091591] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=43] PNIO [ratelimit] time: 1745215793091583, bytes: 5502017, bw: 0.015650 MB/s, add_ts: 1007621, add_bytes: 16535 [2025-04-21 14:09:53.103503] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=34] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:53.103597] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=85] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.104977] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.119049] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00E5-0-0] [lt=45] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:53.119407] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=70] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=12, avg_log_batch_cnt=1, total_group_log_size=7770, avg_group_log_size=647) [2025-04-21 14:09:53.119459] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=12, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:53.121487] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=33] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215792918214000, v:0}, new_max_version={val:1745215792918214000, v:0}, last_min_version={val:1745215792717610000, v:0}, last_max_version={val:1745215792717610000, v:0}, total_time_us=4321, delta_us=203269) [2025-04-21 14:09:53.121538] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=49] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215792918214000, v:0}, min_version={val:1745215792918214000, v:0}, max_version={val:1745215792918214000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:53.134462] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=44] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8800000, replace_num=100000) [2025-04-21 14:09:53.134541] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=77] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:53.145628] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=81] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:53.150162] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=34] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:53.150249] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=62] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=9, avg_log_gen_to_submit_time=38, avg_log_submit_to_flush_time=1989, avg_log_submit_to_slide_time=2009) [2025-04-21 14:09:53.150312] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=29] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1939, avg_log_submit_to_slide_time=1958) [2025-04-21 14:09:53.150350] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=51] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:53.175432] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=40] PNIO [ratelimit] time: 1745215793175424, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007617, add_bytes: 0 [2025-04-21 14:09:53.179825] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7770) [2025-04-21 14:09:53.179967] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7770) [2025-04-21 14:09:53.180034] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=12, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=27, avg_log_submit_to_flush_time=1727, avg_log_submit_to_slide_time=1750) [2025-04-21 14:09:53.180097] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=41] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7770, hit_cnt=12, read_cnt=12, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:53.205051] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=65][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.264804] INFO [STORAGE.TRANS] alloc (ob_ts_response_handler.cpp:108) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=62] ts response task statistics(alloc_count=4182, free_count=2090) [2025-04-21 14:09:53.264873] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=53] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:53.266101] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDF-0-0] [lt=35] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:53.266156] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDDF-0-0] [lt=47] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=57) [2025-04-21 14:09:53.305123] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=59][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.334658] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:53.346249] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=78] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:53.358105] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE32-0-0] [lt=20] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:53.358165] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE32-0-0] [lt=57] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:53.377668] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=61] get number(ret=0, service_type_=0, range=1, base_id=1745215793377250000, start_id=1745215793377250000, end_id=1745215793377250001) [2025-04-21 14:09:53.398692] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:53.398775] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=74] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.405190] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=63][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.421868] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=33] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3972) [2025-04-21 14:09:53.425273] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:53.442599] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:53.444829] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=40] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:53.444964] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=114] temporary file module use no blocks [2025-04-21 14:09:53.445043] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=72] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:53.445097] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=47] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:53.445149] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=49] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254997995036, flush_io_finished_ret_:0, flush_io_finished_round_:185, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:53.445487] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS SERVER] net_in=16kB/s, net_out=16kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:53.445574] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=52] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:53.445820] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=46] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:53.446052] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=37] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:53.446155] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=21] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:6144, iops:2, bw:12259, [delay/us]:prepare:16, schedule:30, submit:6, rt:1407, total:1460) [2025-04-21 14:09:53.446274] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:53.446394] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=105] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:6144, avg_iops:2, avg_bw:12258, [delay/us]: prepare:16, schedule:30, submit:6, device:1407, total:1460) [2025-04-21 14:09:53.446488] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=32] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:53.446574] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=24] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:733, total:750) [2025-04-21 14:09:53.446667] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:53.446722] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=50] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4085, [delay/us]: prepare:0, schedule:0, submit:600000000, device:733, total:750) [2025-04-21 14:09:53.446797] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:53.446830] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:53.449052] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:53.474760] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=68] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.475765] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.475907] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.476017] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=29] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.480133] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=28] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:53.480204] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.481747] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=56] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4153, offset=102510}, end_cursor:ObLogCursor{file_id=3, log_id=4154, offset=102816}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778b4050, len:3986, log_data_len:306, seq:4153, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:53.482228] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE95-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:53.482311] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE95-0-0] [lt=51] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215793264220002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215793264220002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:53.489783] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=133] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4154, offset=102816}, end_cursor:ObLogCursor{file_id=3, log_id=4155, offset=103113}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778b8050, len:3680, log_data_len:297, seq:4154, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:53.490159] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE95-0-0] [lt=42] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:53.490244] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE95-0-0] [lt=52] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215793264220001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215793264220001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:53.505262] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.534857] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=92] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:53.539314] INFO [RPC.OBMYSQL] handle_pending_destroy_list (ob_sql_nio.cpp:978) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=21] can close safely, do destroy(*s={this:0x7f3c20f0a030, session_id:3221487855, trace_id:Y0-0000000000000000-0-0, sql_handling_stage:256, sql_initiative_shutdown:true, reader:{fd:222}, err:5, last_decode_time:1745215792870657, pending_write_task:{buf:null, sz:0}, need_epoll_trigger_write:false, consume_size:567, pending_flag:1, may_handling_flag:false, handler_close_flag:false}) [2025-04-21 14:09:53.539414] INFO [RPC.OBMYSQL] sm_conn_unlock_tenant (obsm_conn_callback.cpp:159) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=77] unlock session of tenant(conn.sessid_=3221487855, proxy_sessid=0, conn.tenant_id_=1) [2025-04-21 14:09:53.539469] INFO [RPC.OBMYSQL] destroy (obsm_conn_callback.cpp:243) [619658][sql_nio3][T0][Y0-0000000000000000-0-0] [lt=52] connection close(sessid=3221487855, proxy_sessid=0, tenant_id=1, server_id=1, from_proxy=false, from_java_client=false, c/s protocol="OB_MYSQL_CS_TYPE", is_need_clear_sessid_=true, is_sess_alloc_=true, ret=0, trace_id=YB420B1D7AB6-00063343B8AEFD8A-0-0, conn.pkt_rec_wrapper_=[start_pkt_pos_:0, cur_pkt_pos_:8, pkt_rec[0]:{send:obp_mysql_header_{len_:11, seq_:3}, pkt_name:"PKT_OKP", obp_mysql_header_.is_send_:1}, pkt_rec[1]:{receive:obp_mysql_header_{len_:457, rec_:457, seq_:0}, pkt_name:"COM_QUERY", obp_mysql_header_.type_:3, obp_mysql_header_.is_send_:0}, pkt_rec[2]:{send:obp_mysql_header_{len_:5, seq_:2}, pkt_name:"PKT_RESHEAD", obp_mysql_header_.is_send_:1}, pkt_rec[3]:{send:obp_mysql_header_{pkt_num_:3, seq_:5}, pkt_name:"PKT_FIELD", obp_mysql_header_.is_send_:1}, pkt_rec[4]:{send:obp_mysql_header_{len_:9, seq_:6}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[5]:{send:obp_mysql_header_{pkt_num_:2, seq_:8}, pkt_name:"PKT_ROW", obp_mysql_header_.is_send_:1}, pkt_rec[6]:{send:obp_mysql_header_{len_:9, seq_:9}, pkt_name:"PKT_EOF", obp_mysql_header_.is_send_:1}, pkt_rec[7]:{receive:obp_mysql_header_{len_:1, rec_:1, seq_:0}, pkt_name:"COM_QUIT", obp_mysql_header_.type_:1, obp_mysql_header_.is_send_:0}], disconnect_state=3) [2025-04-21 14:09:53.539546] INFO [SERVER] run (obmp_disconnect.cpp:82) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=10] free session successfully(sessid=3221487855) [2025-04-21 14:09:53.539585] INFO [SERVER] run (obmp_disconnect.cpp:89) [620043][T1_L0_G0][T1][Y0-0000000000000000-0-0] [lt=37] mark session id unused(sessid=3221487855) [2025-04-21 14:09:53.541857] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0221-0-0] [lt=19][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.544385] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0221-0-0] [lt=49][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254999094692, cache_obj->added_lc()=false, cache_obj->get_object_id()=778, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:53.546916] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:53.570032] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=116] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:53.571265] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620305][T1002_Flush][T1002][Y0-0000000000000000-0-0] [lt=23] ====== traversal_flush timer task ====== [2025-04-21 14:09:53.571424] INFO [MDS] flush (mds_table_mgr.cpp:195) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDAA-0-0] [lt=45] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, max_consequent_callbacked_scn={val:1745215793264220002, v:0}, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:53.571597] INFO [MDS] flush (mds_table_mgr.cpp:172) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDAA-0-0] [lt=132] [FREEZE]no valid mds table there, no need do flush(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1001}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:0, ordered_tablets:{}, max_consequent_callbacked_scn={val:18446744073709551615, v:3}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:53.571671] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620305][T1002_Flush][T1002][YB420B1D7AB6-00063343B09EFDAA-0-0] [lt=71] succeed to traversal_flush(ret=0, ls_cnt=2) [2025-04-21 14:09:53.584329] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=38] gc stale ls task succ [2025-04-21 14:09:53.597129] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=61] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:53.597193] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:53.597228] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=33] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:53.597256] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:53.597281] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=23] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254998147353, flush_io_finished_ret_:0, flush_io_finished_round_:185, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:53.603750] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:53.603805] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=46] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.605337] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=52][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.606399] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=62] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:53.609306] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:53.609350] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:53.611277] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=21][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:53.611314] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=35][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:53.647568] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:53.647639] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:53.649823] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1129, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:53.684176] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] ====== checkpoint timer task ====== [2025-04-21 14:09:53.685265] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=55] succ to get rec scn(*this={this:0x7f3c24a04030, ls_id:{id:1}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176618433003, v:0}, max_applied_start_working_ts_:{val:1745215176618433003, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605716713, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:699}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:53.685337] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=70] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23688080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23688080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:53.685419] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=42] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745215643806921004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50114}, rec_scn:{val:1745215643806921004, v:0}}, }, *this={this:0x7f3c24862510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:53.685533] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=110] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c2486fe10}, min_rec_scn={val:1745214062199618000, v:0}, ls_id_={id:1}) [2025-04-21 14:09:53.685562] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:53.685590] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=23] get rec log scn(service_type_=0, rec_log_ts={val:1745215784255499001, v:0}) [2025-04-21 14:09:53.685609] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] get rec log scn(service_type_=1, rec_log_ts={val:1745215620473222002, v:0}) [2025-04-21 14:09:53.685630] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=11] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:53.685665] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:53.685690] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214062199618000, v:0}, checkpoint_scn_in_ls_meta={val:1745214062199618000, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:53.685724] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:53.685759] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=34] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:53.686767] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=15] succ to get rec scn(*this={this:0x7f3c24ab6030, ls_id:{id:1001}, tenant_id:1002, tx_ls_state_mgr:{ls_id_:{id:1001}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"T_APPLY_PENDING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176667416001, v:0}, max_applied_start_working_ts_:{val:1745215176667416001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215605748518, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:1462}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:53.686809] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=41] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c23689350, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c23689350, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1001}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:53.686859] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:260) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=22] [FREEZE]no valid mds table there, return MAX SCN(ret=0, ret="OB_SUCCESS", min_rec_scn={val:4611686018427387903, v:0}, order_flusher_for_one={high_priority_flusher:size:0, ordered_tablets:{}, *this={this:0x7f3c248b4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:53.686930] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=68] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="DATA_CHECKPOINT_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={this:0x7f3c248c1e10}, min_rec_scn={val:1745214089842480001, v:0}, ls_id_={id:1001}) [2025-04-21 14:09:53.686953] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1001}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1745214072182794000, v:0}) [2025-04-21 14:09:53.686974] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=19] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:53.686998] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=21] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1001}) [2025-04-21 14:09:53.687018] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=18] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214089842480001, v:0}, checkpoint_scn_in_ls_meta={val:1745214089842480001, v:0}, ls_id={id:1001}, service_type="TRANS_SERVICE") [2025-04-21 14:09:53.687040] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:53.687065] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=25] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1001}) [2025-04-21 14:09:53.687083] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620304][T1002_TxCkpt][T1002][Y0-0000000000000000-0-0] [lt=16] succeed to update_clog_checkpoint(ret=0, ls_cnt=2) [2025-04-21 14:09:53.694858] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=39] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695499] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=62] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695508] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695514] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=53] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695576] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=25] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695645] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=49] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695798] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=37] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.695819] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.696038] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=39] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.696094] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=47] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.696289] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:53.705410] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.720600] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7772) [2025-04-21 14:09:53.735073] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=79] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:53.737510] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620288][T1002_LockWaitM][T1002][Y0-0000000000000000-0-0] [lt=79] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:53.747526] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=59] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:53.749333] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=155] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1877, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:53.749397] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=59] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:53.749473] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:53.749517] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2031, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:53.749537] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:53.764755] INFO [SHARE] refresh_primary_cluster_id (ob_alive_server_tracer.cpp:398) [619488][ServerTracerTim][T0][YB420B1D7AB6-00063343ACFEFDAC-0-0] [lt=39] refresh primary cluster finish(ret=0, primary_cluster_id_=-1) [2025-04-21 14:09:53.765435] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=24] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1001, need_refresh=false, gts_local_cache={srr:[mts=1745215793765412], gts:1745215793764987000, latest_srr:[mts=1745215793765412]}) [2025-04-21 14:09:53.767380] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0223-0-0] [lt=42][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.767992] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDE2-0-0] [lt=38] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:53.770454] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0223-0-0] [lt=43][errcode=0] set logical del time(cache_obj->get_logical_del_time()=254999320760, cache_obj->added_lc()=false, cache_obj->get_object_id()=779, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:53.797602] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=73] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:53.805487] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=46][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.808610] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE4B-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.809278] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04B2-0-0] [lt=35][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.810357] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE4C-0-0] [lt=59][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.810373] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04B4-0-0] [lt=45][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.811216] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE4D-0-0] [lt=36][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.811509] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04B6-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.819281] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=37] ====== check clog disk timer task ====== [2025-04-21 14:09:53.819337] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=48] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:53.829666] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=75] gc stale ls task succ [2025-04-21 14:09:53.842425] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=60] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:53.843596] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:53.843679] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=71] temporary file module use no blocks [2025-04-21 14:09:53.843712] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=29] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:53.843751] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=35] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:53.843792] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=39] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254998393814, flush_io_finished_ret_:0, flush_io_finished_round_:185, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:2, normal_idle_loop_cnt_:2, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:53.847628] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=15] tx gc loop thread is running(MTL_ID()=1002) [2025-04-21 14:09:53.847668] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=38] try gc retain ctx [2025-04-21 14:09:53.847683] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] try to retry start_working [2025-04-21 14:09:53.847744] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] finish update min start scn(max_decided_scn={val:1745215793264220005, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215783754395000, v:0}, keep_alive_scn_:{val:1745215788759369000, v:0}, update_ts_:1745215793847347}) [2025-04-21 14:09:53.848731] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=41] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1001, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:53.848699] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=32] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215800473222000, latest_log_ts:{val:1745215784255499001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:53.848822] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=88] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=3, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:53.848867] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=28] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1211, avg_group_log_size=121) [2025-04-21 14:09:53.848896] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:53.848920] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:53.848962] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=18] finish update min start scn(max_decided_scn={val:1745215793264220004, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215783754395000, v:0}, keep_alive_scn_:{val:1745215788759369000, v:0}, update_ts_:1745215793848414}) [2025-04-21 14:09:53.849954] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=43] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:53.849971] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1002, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1002, ls_id:{id:1001}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214089842480001, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176244763001, v:0}, all_id_meta:{id_meta:[{limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c359aa030, is_in_stop_state_:false, is_inited_:true, id_:1001}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1001, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:53.850050] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=34] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215788818388000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:53.850065] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=64] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1333, avg_group_log_size=121) [2025-04-21 14:09:53.850092] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=24] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1342) [2025-04-21 14:09:53.850438] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1211) [2025-04-21 14:09:53.895702] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=56] ====== tenant freeze timer task ====== [2025-04-21 14:09:53.898893] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:53.898953] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=51] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.905571] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=60][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:53.919869] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=60] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:53.927050] INFO pn_ratelimit (group.c:626) [619659][IngressService][T0][Y0-0000000000000000-0-0] [lt=41] PNIO set ratelimit as 9223372036854775807 bytes/s, grp_id=2 [2025-04-21 14:09:53.935268] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=88] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=6) [2025-04-21 14:09:53.948136] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=85] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:53.957570] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=75] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=6600000, clean_num=200000) [2025-04-21 14:09:53.959140] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=32] run rewrite rule refresh task(rule_mgr_->tenant_id_=1001) [2025-04-21 14:09:53.962055] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620120][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=92] get number(ret=0, service_type_=0, range=1, base_id=1745215793961918000, start_id=1745215793961918000, end_id=1745215793961918001) [2025-04-21 14:09:53.963600] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=55] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=2, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:53.963673] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=56] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3413, avg_group_log_size=379) [2025-04-21 14:09:53.963710] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:53.980354] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=24] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:53.980415] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:53.986396] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04B7-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:53.988301] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04B9-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.005640] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=50][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.044749] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=51] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:54.076361] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=56] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1002, server_version={version:{val:1745215793764987000, v:0}, total_part_count:2, valid_inner_part_count:1, valid_user_part_count:1}, server_version_delta=311357, in_cluster_service=true, cluster_version={val:1745215793264220004, v:0}, min_cluster_version={val:1745215793264220004, v:0}, max_cluster_version={val:1745215793264220004, v:0}, get_cluster_version_err=0, cluster_version_delta=812124, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1692, succ_cluster_heartbeat_count=21, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215669124264000, v:0}, local_cluster_delta=124952080, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:54.080259] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04BC-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.080919] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04BD-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.095067] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=77] PNIO [ratelimit] time: 1745215794095061, bytes: 5515809, bw: 0.013107 MB/s, add_ts: 1003478, add_bytes: 13792 [2025-04-21 14:09:54.103939] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:54.104003] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=55] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.105709] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=45][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.114757] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=14] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1001) [2025-04-21 14:09:54.114850] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=84] start lib cache evict(tenant_id=1001, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:54.114896] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=42] end lib cache evict(tenant_id=1001, cache_evict_num=0, mem_hold=46137344, mem_limit=53687090, cache_obj_num=156, cache_node_num=156) [2025-04-21 14:09:54.114954] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=54] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:54.118750] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=32] Dumping All Cache Objs(alloc_obj_list.count()=156, alloc_obj_list=[{obj_id:154, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:157, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:158, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:159, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:160, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:161, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:162, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:163, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200909}, {obj_id:165, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:166, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:167, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:169, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:170, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187527}, {obj_id:174, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206768}, {obj_id:176, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178177}, {obj_id:177, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200508}, {obj_id:179, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:180, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:181, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199316}, {obj_id:182, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191433}, {obj_id:183, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189332}, {obj_id:184, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:185, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:186, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:187, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198472}, {obj_id:188, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189598}, {obj_id:189, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305648}, {obj_id:190, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:191, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:193, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:194, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191556}, {obj_id:195, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:196, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:197, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:199, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176695}, {obj_id:200, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177624}, {obj_id:201, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189984}, {obj_id:202, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199338}, {obj_id:203, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179930}, {obj_id:204, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:205, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:206, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188461}, {obj_id:207, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203213}, {obj_id:208, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:209, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:210, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200506}, {obj_id:211, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:212, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:213, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:214, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:215, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:216, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:217, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:218, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:219, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:220, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:221, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204158}, {obj_id:222, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:224566}, {obj_id:223, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:224, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200553}, {obj_id:225, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194332}, {obj_id:226, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:227, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:228, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:229, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:230, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:231, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:232, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:233, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:234, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:235, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:236, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:237, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:238, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:239, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:240, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:241, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:242, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:243, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:244, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:245, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:246, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:247, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:248, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:249, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:250, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:251, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:252, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:253, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:254, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302952}, {obj_id:255, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231904}, {obj_id:256, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:257, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:258, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200720}, {obj_id:259, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208361}, {obj_id:260, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209150}, {obj_id:261, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192114}, {obj_id:262, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195973}, {obj_id:263, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196360}, {obj_id:264, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195905}, {obj_id:265, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218440}, {obj_id:266, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200682}, {obj_id:267, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178077}, {obj_id:268, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179493}, {obj_id:269, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179059}, {obj_id:270, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190414}, {obj_id:271, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181280}, {obj_id:272, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:273, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196165}, {obj_id:274, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:275, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:276, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:277, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192632}, {obj_id:278, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178267}, {obj_id:279, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:280, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:281, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:282, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:283, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:284, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182180}, {obj_id:285, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:286, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178372}, {obj_id:287, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178945}, {obj_id:288, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:289, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211253}, {obj_id:290, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430158}, {obj_id:292, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325650}, {obj_id:293, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449270}, {obj_id:294, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:295, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202732}, {obj_id:296, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:297, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:298, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:299, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:300, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:301, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:307, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:308, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:310, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178225}, {obj_id:312, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:313, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:314, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:315, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:430, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176768}, {obj_id:431, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:432, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:433, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:450, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217073}, {obj_id:451, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180791}, {obj_id:452, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:453, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218679}, {obj_id:454, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:455, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:456, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185665}, {obj_id:457, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1001, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}]) [2025-04-21 14:09:54.119820] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [620105][T1001_PlanCache][T1001][Y0-0000000000000000-0-0] [lt=1063] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:54.119855] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00EA-0-0] [lt=57] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:54.120299] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=79] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=8319, avg_group_log_size=639) [2025-04-21 14:09:54.120353] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:54.120492] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=50] get_max_applied_scn(scn={val:1745215794021870000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:66018701}, palf_committed_end_scn_:{val:1745215794021870000, v:0}, last_check_scn_:{val:1745215794021870000, v:0}, max_applied_cb_scn_:{val:1745215794021870000, v:0}}) [2025-04-21 14:09:54.120555] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=53] get_min_unreplayed_log_info(lsn={lsn:64037846}, scn={val:1745215176701154001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215615083191, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:737294, ret_code_:0}}, next_to_submit_lsn_:{lsn:64037846}, next_to_submit_scn_:{val:1745215176701154001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745213981413072006, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23a05000, next_round_pread_size:3678208, curr_read_pos:16054, curr_read_buf_start_pos:0, curr_read_buf_end_pos:16054, log_storage_:{start_lsn:{lsn:64021792}, end_lsn:{lsn:64037846}, read_buf:{buf_len_:3747840, buf_:0x7f3c23a05000}, block_size:67104768, log_storage_:0x7f3c6c7c1a30, log_storage_:{log_tail:{lsn:66018701}, readable_log_tail:{lsn:66018701}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1/1/log", dir_fd:130, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:1086067, block_header_serialize_buf_:0x7f3c6c7c26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176701154000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:15966, scn_:{val:1745215176701154000, v:0}, data_checksum:1737866042, flag:10463}}, init_mode_version:0, accumulate_checksum:12874294, curr_entry_is_padding:0, padding_entry_size:15998, padding_entry_scn:{val:1745215176701154000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:20, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:34, read_io_size:64712704, read_disk_cost_ts:390226, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:54.122477] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT WRITE LOG COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1759, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:54.122553] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=54] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=42, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:54.122640] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=16, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:54.122702] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=61] [PALF STAT LOG LIFE TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1930, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:54.122738] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=21] [PALF STAT FLUSH CB COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=68, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:54.122809] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=18] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215793918874000, v:0}, new_max_version={val:1745215793918874000, v:0}, last_min_version={val:1745215793719834000, v:0}, last_max_version={val:1745215793719834000, v:0}, total_time_us=4872, delta_us=203933) [2025-04-21 14:09:54.122851] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=38] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215793918874000, v:0}, min_version={val:1745215793918874000, v:0}, max_version={val:1745215793918874000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:54.135451] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=84] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=5) [2025-04-21 14:09:54.149568] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=18] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1333) [2025-04-21 14:09:54.149610] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT WRITE LOG COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1777, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:54.149657] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=37, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:54.149747] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=11, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:54.149780] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG LIFE TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=1911, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:54.149798] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=12] [PALF STAT FLUSH CB COST TIME](cur_stat_count=11, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:54.158131] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:54.165248] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1736, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:54.165298] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3534) [2025-04-21 14:09:54.165331] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=22] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=43, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:54.165377] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3534) [2025-04-21 14:09:54.165443] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=48] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:54.165468] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1889, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:54.165488] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=33, avg_log_submit_to_flush_time=1832, avg_log_submit_to_slide_time=1855) [2025-04-21 14:09:54.165520] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=23] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=52, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:54.165583] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=40] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3534, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:54.179943] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=8319) [2025-04-21 14:09:54.180010] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=28, avg_log_submit_to_flush_time=1818, avg_log_submit_to_slide_time=1844) [2025-04-21 14:09:54.183044] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=75] PNIO [ratelimit] time: 1745215794183038, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007614, add_bytes: 0 [2025-04-21 14:09:54.205794] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.224496] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=97] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:54.235286] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [619838][T1_TenantMetaMe][T1][Y0-0000000000000000-0-0] [lt=68] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:1075, free_obj_hold_cnt:2, allocator used:4144296, allocator total:4439040}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=4439040, tablets_mem_limit=1073741820, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:114, free_obj_hold_cnt:0, allocator used:233472, allocator total:261120}, pending_cnt=0, wait_gc_count=0, tablet count=1075) [2025-04-21 14:09:54.249607] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1333) [2025-04-21 14:09:54.249690] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=60] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=26, avg_log_submit_to_flush_time=1727, avg_log_submit_to_slide_time=1749) [2025-04-21 14:09:54.249752] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=32] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=11, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1637, avg_log_submit_to_slide_time=1652) [2025-04-21 14:09:54.249789] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=54] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1333, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:54.265918] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=54] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1, need_refresh=false, gts_local_cache={srr:[mts=1745215794265886], gts:1745215794265603000, latest_srr:[mts=1745215794265886]}) [2025-04-21 14:09:54.265971] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=51] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:54.266218] INFO [STORAGE.TRANS] submit_log_ (ob_id_service.cpp:158) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=19] submit log success(service_type_=0, last_id=1745215810473222000, limited_id=1745215810473222000) [2025-04-21 14:09:54.266248] INFO [STORAGE.TRANS] submit_log_with_lock_ (ob_id_service.cpp:65) [619632][TsMgr][T1002][Y0-0000000000000000-0-0] [lt=29] submit log with lock success(service_type_=0, last_id=1745215810473222000, limited_id=1745215810473222000) [2025-04-21 14:09:54.266280] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=19] gts statistics(tenant_id=1002, gts_rpc_cnt=10, get_gts_cache_cnt=413, get_gts_with_stc_cnt=4, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=3, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:54.267560] INFO [STORAGE] update_id_meta (ob_ls_meta.cpp:844) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=18] update id meta(ret=0, service_type=0, limited_id=1745215810473222000, latest_scn={val:1745215794265603001, v:0}, *this={tenant_id:1002, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214062199618000, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:1745215791262320000, v:0}, tablet_change_checkpoint_scn:{val:1745215176618433001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215810473222000, latest_log_ts:{val:1745215794265603001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215620473222002, v:0}}, {limited_id:1, latest_log_ts:{val:18446744073709551615, v:3}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}) [2025-04-21 14:09:54.267720] INFO [STORAGE.TRANS] handle_submit_callback (ob_id_service.cpp:190) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=158] handle submit callback(service_type_=0, success=true, used_ts=1502, log_ts={val:1745215794265603001, v:0}, limited_id=1745215810473222000) [2025-04-21 14:09:54.267764] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:564) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=43] timestamp service handle log callback(ret=0, limited_id=0, log_ts={val:18446744073709551615, v:3}) [2025-04-21 14:09:54.267785] INFO [STORAGE.TRANS] on_success (ob_id_service.cpp:602) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=19] ObPresistIDLogCb on success(ret=0, ret="OB_SUCCESS", *this={log_ts:{val:18446744073709551615, v:3}, log_buf:"", pos:0, id_srv_type:-1, limited_id:0}) [2025-04-21 14:09:54.305862] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=62][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.313609] INFO [SQL.PC] inner_cache_evict (ob_ps_cache.cpp:749) [620638][T1_PsCacheEvict][T1][Y0-0000000000000000-0-0] [lt=91] ps cache evict(tenant_id=1, stmt_id_map_.size()=9, stmt_info_map_.size()=9, op.get_used_size()=21105, get_mem_high()=120795930, expired_stmt_ids.count()=0, closed_stmt_ids.count()=9) [2025-04-21 14:09:54.321562] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=19] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=8907) [2025-04-21 14:09:54.321766] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=8907, hit_cnt=15, read_cnt=15, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:54.321922] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=28] get_max_applied_scn(scn={val:1745215794177737000, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:26614958}, palf_committed_end_scn_:{val:1745215794318956000, v:0}, last_check_scn_:{val:1745215794318956000, v:0}, max_applied_cb_scn_:{val:1745215794177737000, v:0}}) [2025-04-21 14:09:54.322001] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=71] get_min_unreplayed_log_info(lsn={lsn:22574895}, scn={val:1745215176627127001, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215617818090, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2825911, ret_code_:0}}, next_to_submit_lsn_:{lsn:22574895}, next_to_submit_scn_:{val:1745215176627127001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214046518260002, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c23e05000, next_round_pread_size:3678208, curr_read_pos:1275, curr_read_buf_start_pos:0, curr_read_buf_end_pos:1275, log_storage_:{start_lsn:{lsn:22573620}, end_lsn:{lsn:22574895}, read_buf:{buf_len_:3747840, buf_:0x7f3c23e05000}, block_size:67104768, log_storage_:0x7f3c4a4d1a30, log_storage_:{log_tail:{lsn:26614958}, readable_log_tail:{lsn:26614958}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1001/1/log", dir_fd:139, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:40489810, block_header_serialize_buf_:0x7f3c4a4d26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176627127000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176627127000, v:0}, data_checksum:1290388039, flag:40438}}, init_mode_version:0, accumulate_checksum:3446165123, curr_entry_is_padding:0, padding_entry_size:1219, padding_entry_scn:{val:1745215176627127000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:8, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:12, read_io_size:22855680, read_disk_cost_ts:194685, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:54.335598] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=4) [2025-04-21 14:09:54.359092] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43577950208, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:54.360877] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE33-0-0] [lt=21] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:54.360926] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE33-0-0] [lt=45] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:54.380074] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=61, this=0x7f3c3f5fa280, extra_info="") [2025-04-21 14:09:54.380127] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=52] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=2405, this=0x7f3c3f5fa4b0, extra_info="") [2025-04-21 14:09:54.380143] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=15] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c3f5fa6e0, extra_info="") [2025-04-21 14:09:54.380157] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=-464, this=0x7f3c3f5fa910, extra_info="") [2025-04-21 14:09:54.380181] INFO [LIB] stat (utility.h:1176) [620131][T1001_ApplySrv0][T1001][Y0-0000000000000000-0-0] [lt=22] [APPLY STAT CB TOTAL TIME](cur_stat_count=56, stat_interval=5000000, avg (count/cost)=2002, this=0x7f3c3f5fab40, extra_info="") [2025-04-21 14:09:54.380196] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=92] get_max_applied_scn(scn={val:1745215794265603001, v:0}, this={ls_id_:{id:1}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:17433518}, palf_committed_end_scn_:{val:1745215794265603001, v:0}, last_check_scn_:{val:1745215794265603001, v:0}, max_applied_cb_scn_:{val:1745215794265603001, v:0}}) [2025-04-21 14:09:54.380261] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=55] get_min_unreplayed_log_info(lsn={lsn:16036966}, scn={val:1745215176618433003, v:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17433518}, readable_log_tail:{lsn:17433518}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49671250, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:54.391266] INFO [SQL.DTL] runTimerTask (ob_dtl_interm_result_manager.cpp:644) [620124][T1001_TntShared][T1001][Y0-0000000000000000-0-0] [lt=37] clear dtl interm result cost(us)(clear_cost=8, ret=0, gc_.expire_keys_.count()=0, dump count=0, clean count=0) [2025-04-21 14:09:54.399064] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:54.399136] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.402269] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=24] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:54.402332] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=47] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:54.402360] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620167][T1001_ObTimer][T1001][Y0-0000000000000000-0-0] [lt=23] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=38) [2025-04-21 14:09:54.404514] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:252) [620165][T1001_Flush][T1001][Y0-0000000000000000-0-0] [lt=14] ====== traversal_flush timer task ====== [2025-04-21 14:09:54.404654] INFO [MDS] flush (mds_table_mgr.cpp:195) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDAB-0-0] [lt=41] [FREEZE]no need do flush cause min_rec_scn is larger than freezing scn(ret=0, ret="OB_SUCCESS", ls_->get_ls_id()={id:1}, recycle_scn={val:4611686018427387903, v:0}, need_freeze=false, order_flusher_for_some={high_priority_flusher:size:2, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, {tablet_id:{id:50114}, rec_scn:{val:1745214056229815006, v:0}}, }, max_consequent_callbacked_scn={val:1745215794318956000, v:0}, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215807945792000, latest_log_ts:{val:1745215791316720001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:54.404788] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:287) [620165][T1001_Flush][T1001][YB420B1D7AB6-00063343AFBEFDAB-0-0] [lt=128] succeed to traversal_flush(ret=0, ls_cnt=1) [2025-04-21 14:09:54.405930] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=49][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.412483] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=21] ====== check clog disk timer task ====== [2025-04-21 14:09:54.412553] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620166][T1001_CKClogDis][T1001][Y0-0000000000000000-0-0] [lt=58] get_disk_usage(ret=0, capacity(MB):=614, used(MB):=89) [2025-04-21 14:09:54.422792] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=61] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=3411) [2025-04-21 14:09:54.425360] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:54.442807] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=66] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:54.445278] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=54] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:54.445344] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=56] temporary file module use no blocks [2025-04-21 14:09:54.445362] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:54.445384] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=19] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:54.445418] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=33] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254998995520, flush_io_finished_ret_:0, flush_io_finished_round_:186, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:54.447910] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=25] [IO STATUS SERVER] net_in=12kB/s, net_out=12kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:54.447972] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=38] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:54.448177] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=31] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:54.448375] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=34] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:54.448464] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=23] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8173, [delay/us]:prepare:36, schedule:64, submit:10, rt:1659, total:1770) [2025-04-21 14:09:54.448540] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:54.448607] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=58] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:36, schedule:64, submit:10, device:1659, total:1770) [2025-04-21 14:09:54.448679] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:54.448756] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4087, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:1082, total:1121) [2025-04-21 14:09:54.448838] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:54.448878] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=35] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4087, [delay/us]: prepare:0, schedule:0, submit:600000000, device:1082, total:1121) [2025-04-21 14:09:54.448943] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:54.448971] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:54.450542] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1211) [2025-04-21 14:09:54.456355] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:131) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=30] ====== checkpoint timer task ====== [2025-04-21 14:09:54.457352] INFO [STORAGE.TRANS] get_rec_scn (ob_trans_ctx_mgr_v4.cpp:1430) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=42] succ to get rec scn(*this={this:0x7f3c3e604030, ls_id:{id:1}, tenant_id:1001, tx_ls_state_mgr:{ls_id_:{id:1}, cur_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, prev_state_.state_val_:{state_:"L_WORKING", offline_flag_:0, block_start_tx_flag_:0, block_start_normal_tx_flag_:0, block_start_readonly_flag_:0}, max_applying_start_working_ts_:{val:1745215176627127001, v:0}, max_applied_start_working_ts_:{val:1745215176627127001, v:0}}, total_tx_ctx_count:0, active_tx_count:0, ls_retain_ctx_mgr:{retain_ctx_list_.get_size():0, max_wait_ckpt_ts_:{val:18446744073709551615, v:3}, last_push_gc_task_ts_:1745215602674821, skip_remove_cnt_:0}, aggre_rec_scn:{val:18446744073709551615, v:3}, prev_aggre_rec_scn:{val:18446744073709551615, v:3}, uref:962}, aggre_rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:54.457432] INFO [STORAGE.TRANS] get_rec_scn (ob_tx_ctx_memtable.cpp:182) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=79] tx ctx memtable get rec scn(this={ObITable:{this:0x7f3c3c0c2080, key:{tablet_id:{id:49401}, column_group_idx:0, table_type:"TX_CTX_MEMTABLE", scn_range:{start_scn:{val:1, v:0}, end_scn:{val:2, v:0}}}, ref_cnt:2, upper_trans_version:-4007, timestamp:0}, this:0x7f3c3c0c2080, snapshot_version:{val:4611686018427387903, v:0}, ls_id:{id:1}, is_frozen:false}, rec_scn={val:4611686018427387903, v:0}) [2025-04-21 14:09:54.457523] INFO [MDS] get_rec_scn (mds_table_mgr.cpp:265) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=51] [FREEZE]get rec_scn from MdsTableMgr(ret=0, ret="OB_SUCCESS", min_rec_scn={val:1745214056229815004, v:0}, order_flusher_for_one={high_priority_flusher:size:1, ordered_tablets:{{tablet_id:{id:50003}, rec_scn:{val:1745214056229815004, v:0}}, }, *this={this:0x7f3c3efe4510, is_inited:true, freezing_scn:{val:0, v:0}, ls:{running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215807945792000, latest_log_ts:{val:1745215791316720001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}}) [2025-04-21 14:09:54.457636] INFO [STORAGE.TRANS] get_rec_scn (ob_ls_tx_service.cpp:636) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=108] [CHECKPOINT] ObLSTxService::get_rec_scn(common_checkpoint_type="TX_DATA_MEMTABLE_TYPE", common_checkpoints_[min_rec_scn_common_checkpoint_type_index]={ObIMemtableMgr:{Memtables:this:0x7f3c3efe41b0, ref_cnt:1, is_inited:true, tablet_id:{id:49402}, freezer:0x7f3c3efee390, memtable_head:0, memtable_tail:1, t3m:0x7f3c4dcdc030, tables:[0x7f3c3c0b2080, null, null, null, null, null, null, null, null, null, null, null, null, null, null, null]}, is_freezing:false, ls_id:{id:1}, mini_merge_recycle_commit_versions_ts:0, tx_data_table:0x7f3c3eff0050, ls_tablet_svr:0x7f3c3efe4190}, min_rec_scn={val:1745214046518260002, v:0}, ls_id_={id:1}) [2025-04-21 14:09:54.457684] INFO [STORAGE] get_rec_scn (ob_ls_ddl_log_handler.cpp:501) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=40] [CHECKPOINT] ObLSDDLLogHandler::get_rec_scn(ret=0, ls_id={id:1}, barrier_tablet_id={id:0}, rec_scn={val:4611686018427387903, v:0}, last_rec_scn={val:1, v:0}) [2025-04-21 14:09:54.457712] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=24] get rec log scn(service_type_=0, rec_log_ts={val:1745215791316720001, v:0}) [2025-04-21 14:09:54.457733] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=20] get rec log scn(service_type_=1, rec_log_ts={val:1745215617969773007, v:0}) [2025-04-21 14:09:54.457753] INFO [STORAGE.TRANS] get_rec_scn (ob_id_service.cpp:308) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=17] get rec log scn(service_type_=2, rec_log_ts={val:1745215617969773001, v:0}) [2025-04-21 14:09:54.457777] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=18] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:54.457811] INFO [STORAGE.TABLELOCK] get_rec_scn (ob_lock_memtable.cpp:1216) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=28] rec_scn of ObLockMemtable is (rec_scn_={val:4611686018427387903, v:0}, flushed_scn_={val:0, v:0}, pre_rec_scn_={val:4611686018427387903, v:0}, freeze_scn_={val:0, v:0}, max_committed_scn_={val:18446744073709551615, v:3}, is_frozen_=false, ls_id_={id:1}) [2025-04-21 14:09:54.457837] INFO [STORAGE] update_clog_checkpoint (ob_checkpoint_executor.cpp:189) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] [CHECKPOINT] clog checkpoint no change(checkpoint_scn={val:1745214046518260002, v:0}, checkpoint_scn_in_ls_meta={val:1745214046518260002, v:0}, ls_id={id:1}, service_type="TRANS_SERVICE") [2025-04-21 14:09:54.457871] WDIAG [PALF] set_base_lsn (palf_handle_impl.cpp:1662) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22][errcode=0] no need to set new base lsn, curr base lsn is greater than or equal to new base lsn(this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, log_snapshot_meta={version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, new_base_lsn={lsn:0}, lsn={lsn:0}) [2025-04-21 14:09:54.457918] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:188) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=46] [CHECKPOINT] advance palf base lsn successfully(checkpoint_lsn={lsn:0}, ls->get_ls_id()={id:1}) [2025-04-21 14:09:54.457942] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:195) [620164][T1001_TxCkpt][T1001][Y0-0000000000000000-0-0] [lt=22] succeed to update_clog_checkpoint(ret=0, ls_cnt=1) [2025-04-21 14:09:54.458629] WDIAG read_and_convert_to_tuples_ (ob_table_access_helper.h:419) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=40][errcode=-4008] iter failed(iter_times=0, ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:54.458839] WDIAG read_multi_row (ob_table_access_helper.h:238) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=73][errcode=-4008] fail to read and convert to tuples(ret=-4008, ret="OB_ITER_END", MTL_ID()=1001, table=oceanbase.__all_detect_lock_info, condition=WHERE detect_func_no = 1 GROUP BY owner_id) [2025-04-21 14:09:54.460157] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620107][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=47] ====== tenant freeze timer task ====== [2025-04-21 14:09:54.461257] INFO delete_row (ob_table_access_helper.h:312) [620150][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=50] GCTX.sql_proxy_ insert row success(ret=0, ret="OB_SUCCESS", MTL_ID()=1001, table=oceanbase.__all_dbms_lock_allocated, value=expiration <= usec_to_time(1745215794458890) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10, sql=DELETE FROM oceanbase.__all_dbms_lock_allocated WHERE expiration <= usec_to_time(1745215794458890) AND lockid NOT IN (SELECT obj_id FROM oceanbase.__all_detect_lock_info where obj_type = 13 or obj_type = 11)LIMIT 10) [2025-04-21 14:09:54.475455] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=56] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.475522] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=38] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.475883] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=139] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.475882] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=64] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.476706] INFO [CLOG] get_max_applied_scn (ob_log_apply_service.cpp:745) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=103] get_max_applied_scn(scn={val:1745215794265603000, v:0}, this={ls_id_:{id:1001}, role_:1, proposal_id_:3, palf_committed_end_lsn_:{lsn:9206871}, palf_committed_end_scn_:{val:1745215794265603001, v:0}, last_check_scn_:{val:1745215794265603001, v:0}, max_applied_cb_scn_:{val:1745215794265603000, v:0}}) [2025-04-21 14:09:54.476762] INFO [CLOG] get_min_unreplayed_log_info (ob_replay_status.cpp:1045) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=50] get_min_unreplayed_log_info(lsn={lsn:8363958}, scn={val:1745215176667416001, v:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:2, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9206871}, readable_log_tail:{lsn:9206871}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57897897, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:54.480567] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:54.480629] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=53] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.496720] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=94] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4155, offset=103113}, end_cursor:ObLogCursor{file_id=3, log_id=4156, offset=103419}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778bc050, len:3383, log_data_len:306, seq:4155, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:54.497134] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE96-0-0] [lt=46] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:54.497195] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE96-0-0] [lt=37] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215794265603002, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215794265603002, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:54.500623] INFO [SHARE] update_tenant_recovery_status_in_trans (ob_tenant_info_proxy.cpp:490) [620231][T1002_TeRec][T1002][YB420B1D7AB6-00063343AEEEFE96-0-0] [lt=15] tenant scn gap info(IS_MAX_GAP_REACHED=false, REAL_GAP=0, MAX_GAP=900000000000, new_sync_scn={val:1745215793264220001, v:0}, new_replayable_scn={val:1745215793264220001, v:0}, new_readable_scn={val:1745215793264220001, v:0}, old_tenant_info={tenant_id:1002, tenant_role:"PRIMARY", switchover_status:"NORMAL", switchover_epoch:0, sync_scn:1745215792263035001, replayable_scn:1745215792263035001, readable_scn:1745215792263035000, recovery_until_scn:4611686018427387903, log_mode:"NOARCHIVELOG", max_ls_id:1001, restore_data_mode:{restore data mode:"NORMAL"}}) [2025-04-21 14:09:54.503942] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=54] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4156, offset=103419}, end_cursor:ObLogCursor{file_id=3, log_id=4157, offset=103716}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778c0050, len:3077, log_data_len:297, seq:4156, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:54.504200] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE96-0-0] [lt=36] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:54.504250] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE96-0-0] [lt=32] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215794265603001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215794265603001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:54.505954] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.535725] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=48] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=3) [2025-04-21 14:09:54.548657] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0225-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.551252] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0225-0-0] [lt=38][errcode=0] set logical del time(cache_obj->get_logical_del_time()=255000101559, cache_obj->added_lc()=false, cache_obj->get_object_id()=780, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:54.559728] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=160] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:54.569991] INFO [STORAGE.TRANS] dump_mapper_info (ob_lock_wait_mgr.h:67) [620149][T1001_LockWaitM][T1001][Y0-0000000000000000-0-0] [lt=42] report RowHolderMapper summary info(count=0, bkt_cnt=248) [2025-04-21 14:09:54.575367] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:09:54.575423] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [620306][T1002_CKClogDis][T1002][Y0-0000000000000000-0-0] [lt=47] get_disk_usage(ret=0, capacity(MB):=5529, used(MB):=153) [2025-04-21 14:09:54.584413] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=42] gc stale ls task succ [2025-04-21 14:09:54.597415] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=56] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:54.597471] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=48] temporary file module use no blocks [2025-04-21 14:09:54.597490] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=16] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:54.597521] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=28] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:54.597548] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620287][T1002_TFSwap][T1002][Y0-0000000000000000-0-0] [lt=26] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254999147656, flush_io_finished_ret_:0, flush_io_finished_round_:186, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:54.604147] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:54.604199] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=44] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.606029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.606569] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=36] start do ls ha handler(ls_id_array_=[{id:1001}, {id:1}]) [2025-04-21 14:09:54.609209] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=15][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:54.609254] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:54.610915] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=33][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:54.610952] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=34][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:54.649250] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:54.649304] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:54.650410] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] ====== tenant freeze timer task ====== [2025-04-21 14:09:54.650462] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1686) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=44] [TenantFreezer] tenant have inactive memstores(ctx.freezable_active_memstore_used_=35651584, ctx.total_memstore_used_=69206016, ctx.total_memstore_hold_=69206016, memstore_freeze_trigger_limit_=61686560, tenant_id=1002) [2025-04-21 14:09:54.650514] INFO [STORAGE] log_frozen_memstore_info_if_need_ (ob_tenant_freezer.cpp:1690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=22] [TenantFreezer] oldest frozen memtable(list="") [2025-04-21 14:09:54.650564] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=23] TxData Memory Statistic(logstream info): (ls_id={id:1}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=4) [2025-04-21 14:09:54.650596] INFO [STORAGE] get_ls_tx_data_memory_info_ (ob_tenant_freezer.cpp:690) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=29] TxData Memory Statistic(logstream info): (ls_id={id:1001}, Frozen TxData Memory(MB)=0, Active TxData Memory(MB)=16) [2025-04-21 14:09:54.650612] INFO [STORAGE] check_and_freeze_tx_data_ (ob_tenant_freezer.cpp:596) [620245][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=14] TxData Memory Statistic : (Tenant Total Memory(MB)=1024, Tenant Frozen TxData Memory(MB)=0, Tenant Active TxData Memory(MB)=20, Freeze TxData Trigger Memory(MB)=20, Total TxDataTable Hold Memory(MB)=26, Total TxDataTable Memory Limit(MB)=204) [2025-04-21 14:09:54.650867] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=49] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1308, hit_cnt=11, read_cnt=11, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:54.655989] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=21] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:54.656049] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [620308][T1002_TabletShe][T1002][Y0-0000000000000000-0-0] [lt=45] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=36) [2025-04-21 14:09:54.656963] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:54.657038] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=59] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:54.657067] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=26] [tabletchange] task check ls(ls->get_ls_id()={id:1001}, tablet_persist_trigger=0) [2025-04-21 14:09:54.657089] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [620307][T1002_ObTimer][T1002][Y0-0000000000000000-0-0] [lt=20] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=2, times=36) [2025-04-21 14:09:54.672623] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:106) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=125] tx gc loop thread is running(MTL_ID()=1001) [2025-04-21 14:09:54.672667] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:113) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=42] try gc retain ctx [2025-04-21 14:09:54.672682] INFO [STORAGE.TRANS] run1 (ob_tx_loop_worker.cpp:120) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=15] try to retry start_working [2025-04-21 14:09:54.672731] INFO [STORAGE] update_min_start_scn_info (ob_tx_table.cpp:1053) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=11] finish update min start scn(max_decided_scn={val:1745215794578044000, v:0}, ctx_min_start_scn_info_={min_start_scn_in_ctx_:{val:1745215784569395001, v:0}, keep_alive_scn_:{val:1745215789573707001, v:0}, update_ts_:1745215794671972}) [2025-04-21 14:09:54.673694] INFO [STORAGE.TRANS] do_tx_gc_ (ob_tx_loop_worker.cpp:271) [620180][T1001_TxLoopWor][T1001][Y0-0000000000000000-0-0] [lt=31] [Tx Loop Worker] check tx scheduler success(MTL_ID()=1001, *ls_ptr={running_state:{state:1}, ls_meta:{tenant_id:1001, ls_id:{id:1}, ls_persistent_state:{state:1}, clog_checkpoint_scn:{val:1745214046518260002, v:0}, clog_base_lsn:{lsn:0}, rebuild_seq:0, migration_status:0, gc_state_:1, offline_scn_:{val:18446744073709551615, v:3}, restore_status:{status:0}, replayable_point:{val:18446744073709551615, v:3}, tablet_change_checkpoint_scn:{val:1745214047818240001, v:0}, all_id_meta:{id_meta:[{limited_id:1745215807945792000, latest_log_ts:{val:1745215791316720001, v:0}}, {limited_id:3000001, latest_log_ts:{val:1745215617969773007, v:0}}, {limited_id:30000001, latest_log_ts:{val:1745215617969773001, v:0}}]}, transfer_scn:{val:0, v:0}, rebuild_info:{status:{status:0}, type:{type:0}, tablet_id_array:{id_array:[]}, src:[type = 0], [address = ]}, transfer_meta_info:{src_ls:{id:0}, src_scn:{val:1, v:0}, trans_status:0, tablet_id_array:{id_array:[]}, data_version:1(0, 0, 1)}, store_format:{store_type:1, store_type_str:"NORMAL"}}, switch_epoch:1, log_handler:{role:1, proposal_id:3, palf_env_:0x7f3c4a3aa030, is_in_stop_state_:false, is_inited_:true, id_:1}, restore_handler:{is_inited:true, is_in_stop_state:false, id:1, proposal_id:9223372036854775807, role:2, parent:null, context:{issue_task_num:0, issue_version:-1, last_fetch_ts:-1, max_submit_lsn:{lsn:18446744073709551615}, max_fetch_lsn:{lsn:18446744073709551615}, max_fetch_scn:{val:18446744073709551615, v:3}, error_context:{ret_code:0, trace_id:Y0-0000000000000000-0-0, error_type:0, err_lsn:{lsn:18446744073709551615}}, task_count:0}, restore_context:{seek_done:false, lsn:{lsn:18446744073709551615}}}, is_inited:true, tablet_gc_handler:{tablet_persist_trigger:0, is_inited:true}, startup_transfer_info:{ls_id:{id:0}, transfer_start_scn:{val:18446744073709551615, v:3}}, need_delay_resource_recycle:false}) [2025-04-21 14:09:54.691429] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:40) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=28] ====== [emptytablet] empty shell timer task ======(GC_EMPTY_TABLET_SHELL_INTERVAL=5000000) [2025-04-21 14:09:54.691485] INFO [STORAGE] runTimerTask (ob_empty_shell_task.cpp:101) [619983][T1_TabletShellT][T1][Y0-0000000000000000-0-0] [lt=43] [emptytablet] succeed to change tablet to empty shell(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=38) [2025-04-21 14:09:54.695006] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:162) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=21] ====== [tabletchange] timer task ======(GC_CHECK_INTERVAL=5000000) [2025-04-21 14:09:54.695055] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:196) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=38] [tabletchange] task check ls(ls->get_ls_id()={id:1}, tablet_persist_trigger=0) [2025-04-21 14:09:54.695080] INFO [STORAGE] runTimerTask (ob_tablet_gc_service.cpp:290) [619982][T1_ObTimer][T1][Y0-0000000000000000-0-0] [lt=23] [tabletchange] succeed to gc_tablet(ret=0, ret="OB_SUCCESS", ls_cnt=1, times=38) [2025-04-21 14:09:54.695518] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=42] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695588] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695655] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695664] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=46] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695733] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695814] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=32] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695916] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=47] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.695938] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=76] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.696173] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=40] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.696379] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=42] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.696587] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=44] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:54.706099] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.710523] WDIAG [SHARE] inner_get_ls_status_ (ob_ls_status_operator.cpp:954) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=47][errcode=-4018] ls not exist in __all_ls_status table(ret=-4018, ret="OB_ENTRY_NOT_EXIST") [2025-04-21 14:09:54.710652] WDIAG [SHARE] get_duplicate_ls_status_info (ob_ls_status_operator.cpp:673) [620130][T1001_DupTbLeas][T1001][Y0-0000000000000000-0-0] [lt=40][errcode=-4018] fail to inner get ls status info(ret=-4018, ret="OB_ENTRY_NOT_EXIST", sql=SELECT * FROM __all_ls_status where tenant_id = 1001 and flag like "%DUPLICATE%", tenant_id=1001, exec_tenant_id=1, need_member_list=false) [2025-04-21 14:09:54.718724] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620296][T1002_LCLSender][T1002][Y0-0000000000000000-0-0] [lt=59] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c39dfe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:54.735815] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=50] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=2) [2025-04-21 14:09:54.750747] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1402, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:54.750800] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=44] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=27, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:54.750894] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=8, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:54.750937] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1523, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:54.750966] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=46, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:54.760091] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620072][T1001_Occam][T1001][YB420B1D7AB6-00063343AE1EFE1D-0-0] [lt=40] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:54.760962] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=64] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:54.766541] INFO [STORAGE.TRANS] statistics (ob_gts_source.cpp:70) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=26] gts statistics(tenant_id=1001, gts_rpc_cnt=10, get_gts_cache_cnt=408, get_gts_with_stc_cnt=62, try_get_gts_cache_cnt=0, try_get_gts_with_stc_cnt=0, wait_gts_elapse_cnt=62, try_wait_gts_elapse_cnt=0) [2025-04-21 14:09:54.778502] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=97] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=9021) [2025-04-21 14:09:54.790659] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [620205][T1002_Occam][T1002][YB420B1D7AB6-00063343AF9EFE1B-0-0] [lt=47] for each ls(succ_num=2, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:54.797802] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=107] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:54.806240] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:120) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=56] tenant info is invalid(ret=-4076, query_ts=0, standby_scn={val:0, v:0}, this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:54.806268] INFO [STORAGE.TRANS] query_and_update_last_id (ob_standby_timestamp_service.cpp:134) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=26] ObStandbyTimestampService state(*this={inited:true, last_id:-1, tenant_id:1002, epoch:-1, self:"11.29.122.182:2882", switch_to_leader_ts:-1}) [2025-04-21 14:09:54.806285] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=17][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.811381] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C0-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.812415] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C1-0-0] [lt=37][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.812712] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDD9-0-0] [lt=88][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.813958] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C2-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.814613] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C3-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.814718] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE50-0-0] [lt=29][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.829749] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=45] gc stale ls task succ [2025-04-21 14:09:54.842605] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=51] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:54.843936] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=62] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:54.843992] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=47] temporary file module use no blocks [2025-04-21 14:09:54.844009] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=15] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:54.844034] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=22] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=6578, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:54.844061] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [619960][T1_TFSwap][T1][Y0-0000000000000000-0-0] [lt=25] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254999394171, flush_io_finished_ret_:0, flush_io_finished_round_:186, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:54.849377] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=23] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:54.849443] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=50] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1226, avg_group_log_size=122) [2025-04-21 14:09:54.849472] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1217) [2025-04-21 14:09:54.849495] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:54.850805] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1226) [2025-04-21 14:09:54.851016] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=25] [APPLY STAT CB APPEND COST TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=66, this=0x7f3c26bfa280, extra_info="") [2025-04-21 14:09:54.851055] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=37] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1649, this=0x7f3c26bfa4b0, extra_info="") [2025-04-21 14:09:54.851071] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=14] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c26bfa6e0, extra_info="") [2025-04-21 14:09:54.851091] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=18] [APPLY STAT CB EXECUTE TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=-564, this=0x7f3c26bfa910, extra_info="") [2025-04-21 14:09:54.851110] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=19] [APPLY STAT CB TOTAL TIME](cur_stat_count=29, stat_interval=5000000, avg (count/cost)=1151, this=0x7f3c26bfab40, extra_info="") [2025-04-21 14:09:54.899257] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=27] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:54.899329] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=63] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.906271] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=23][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:54.910669] INFO [CLOG] is_in_sync (ob_log_handler.cpp:709) [620349][BlackListServic][T1][YB420B1D7AB6-00063343AFAEFDFE-0-0] [lt=32] is_in_sync(ret=0, id=1, is_log_sync=true, is_need_rebuild=false) [2025-04-21 14:09:54.915575] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620263][T1002_TenantMet][T1002][Y0-0000000000000000-0-0] [lt=81] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:2157, free_obj_hold_cnt:1, allocator used:8303984, allocator total:8812800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:1, free_obj_hold_cnt:1, allocator used:131182, allocator total:131182}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=8943982, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:164, free_obj_hold_cnt:0, allocator used:335872, allocator total:391680}, pending_cnt=0, wait_gc_count=0, tablet count=2158) [2025-04-21 14:09:54.916731] INFO [STORAGE.TRANS] print_stat_ (ob_black_list.cpp:396) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=50] start to print blacklist info [2025-04-21 14:09:54.916890] INFO [STORAGE.TRANS] run1 (ob_black_list.cpp:193) [620349][BlackListServic][T0][Y0-0000000000000000-0-0] [lt=38] ls blacklist refresh finish(cost_time=9307) [2025-04-21 14:09:54.920146] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=102] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=14, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:54.921604] INFO [SHARE] blacklist_loop_ (ob_server_blacklist.cpp:313) [619611][Blacklist][T0][Y0-0000000000000000-0-0] [lt=38] blacklist_loop exec finished(cost_time=29, is_enabled=true, send_cnt=0) [2025-04-21 14:09:54.929384] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [619782][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=49] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}]) [2025-04-21 14:09:54.935937] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=41] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=1) [2025-04-21 14:09:54.949525] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=11, avg_log_batch_cnt=1, total_group_log_size=1342, avg_group_log_size=122) [2025-04-21 14:09:54.949574] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1333) [2025-04-21 14:09:54.953917] INFO [SQL.PC] update_memory_conf (ob_plan_cache.cpp:1969) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] update plan cache memory config(ob_plan_cache_percentage=5, ob_plan_cache_evict_high_percentage=90, ob_plan_cache_evict_low_percentage=50, tenant_id=1) [2025-04-21 14:09:54.953982] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1471) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=55] start lib cache evict(tenant_id=1, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:54.954006] INFO [SQL.PC] cache_evict (ob_plan_cache.cpp:1488) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=20] end lib cache evict(tenant_id=1, cache_evict_num=0, mem_hold=92274688, mem_limit=268435455, cache_obj_num=333, cache_node_num=332) [2025-04-21 14:09:54.954023] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2755) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=15] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:54.957405] INFO [SQL.PC] dump_all_objs (ob_plan_cache.cpp:2473) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=13] Dumping All Cache Objs(alloc_obj_list.count()=333, alloc_obj_list=[{obj_id:94, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176706}, {obj_id:95, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177936}, {obj_id:96, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176316}, {obj_id:97, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:546857}, {obj_id:98, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:332781}, {obj_id:99, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:263882}, {obj_id:100, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:306185}, {obj_id:101, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237299}, {obj_id:102, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197078}, {obj_id:103, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220843}, {obj_id:104, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182098}, {obj_id:105, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187565}, {obj_id:107, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208358}, {obj_id:108, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176789}, {obj_id:109, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175176}, {obj_id:110, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209147}, {obj_id:111, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197995}, {obj_id:112, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:305636}, {obj_id:113, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177303}, {obj_id:114, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182615}, {obj_id:115, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190437}, {obj_id:116, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181777}, {obj_id:117, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193961}, {obj_id:118, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233905}, {obj_id:119, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189351}, {obj_id:120, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198302}, {obj_id:121, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178200}, {obj_id:122, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174496}, {obj_id:123, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:323711}, {obj_id:124, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198488}, {obj_id:125, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199285}, {obj_id:126, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175888}, {obj_id:127, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200505}, {obj_id:128, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218126}, {obj_id:129, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:239134}, {obj_id:130, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199118}, {obj_id:131, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219319}, {obj_id:132, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204424}, {obj_id:133, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200617}, {obj_id:134, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194396}, {obj_id:135, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216070}, {obj_id:136, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201003}, {obj_id:137, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205102}, {obj_id:138, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190103}, {obj_id:139, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187931}, {obj_id:140, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186618}, {obj_id:141, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:201681}, {obj_id:142, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195588}, {obj_id:143, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189478}, {obj_id:144, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186785}, {obj_id:145, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189833}, {obj_id:146, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186817}, {obj_id:147, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187803}, {obj_id:148, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189826}, {obj_id:149, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192865}, {obj_id:150, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186753}, {obj_id:151, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192519}, {obj_id:152, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176128}, {obj_id:153, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219094}, {obj_id:154, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193237}, {obj_id:155, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:156, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184242}, {obj_id:157, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212145}, {obj_id:158, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184266}, {obj_id:159, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189255}, {obj_id:160, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184666}, {obj_id:161, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193112}, {obj_id:162, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184354}, {obj_id:163, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185558}, {obj_id:164, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192356}, {obj_id:165, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187754}, {obj_id:166, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:338120}, {obj_id:167, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:267071}, {obj_id:168, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329016}, {obj_id:169, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:257979}, {obj_id:170, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176274}, {obj_id:171, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174830}, {obj_id:172, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195163}, {obj_id:173, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193880}, {obj_id:174, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189125}, {obj_id:175, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184138}, {obj_id:176, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186275}, {obj_id:177, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198468}, {obj_id:178, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220503}, {obj_id:179, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182240}, {obj_id:180, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211261}, {obj_id:181, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203263}, {obj_id:182, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188440}, {obj_id:183, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200503}, {obj_id:184, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209017}, {obj_id:185, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178796}, {obj_id:186, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:219285}, {obj_id:187, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188608}, {obj_id:188, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174800}, {obj_id:189, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200906}, {obj_id:190, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199256}, {obj_id:191, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:218790}, {obj_id:192, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:222069}, {obj_id:193, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178049}, {obj_id:194, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175145}, {obj_id:195, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175224}, {obj_id:196, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175148}, {obj_id:197, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176438}, {obj_id:198, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209535}, {obj_id:199, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179463}, {obj_id:200, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191458}, {obj_id:201, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191570}, {obj_id:202, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178572}, {obj_id:203, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184027}, {obj_id:204, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196790}, {obj_id:205, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187687}, {obj_id:206, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181347}, {obj_id:207, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182697}, {obj_id:208, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175256}, {obj_id:209, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190183}, {obj_id:210, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194474}, {obj_id:211, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199485}, {obj_id:212, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175312}, {obj_id:213, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179828}, {obj_id:214, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248114}, {obj_id:215, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:225249}, {obj_id:216, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:234831}, {obj_id:217, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187114}, {obj_id:218, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187626}, {obj_id:219, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156511}, {obj_id:220, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182174}, {obj_id:221, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198920}, {obj_id:222, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182861}, {obj_id:223, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181000}, {obj_id:224, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:172608}, {obj_id:225, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179080}, {obj_id:226, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193254}, {obj_id:227, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194342}, {obj_id:228, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174448}, {obj_id:229, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173755}, {obj_id:230, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173952}, {obj_id:231, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175072}, {obj_id:232, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174016}, {obj_id:233, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:317541}, {obj_id:234, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:339537}, {obj_id:235, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:202850}, {obj_id:236, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190007}, {obj_id:237, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:235018}, {obj_id:238, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174672}, {obj_id:239, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190321}, {obj_id:240, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175915}, {obj_id:241, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:215704}, {obj_id:242, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189503}, {obj_id:243, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192654}, {obj_id:244, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181386}, {obj_id:245, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178296}, {obj_id:246, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:430170}, {obj_id:248, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:325638}, {obj_id:249, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:449122}, {obj_id:250, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:369041}, {obj_id:251, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291531}, {obj_id:252, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181334}, {obj_id:253, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193015}, {obj_id:254, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291532}, {obj_id:255, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:256, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221018}, {obj_id:257, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156398}, {obj_id:265, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:189563}, {obj_id:275, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156416}, {obj_id:276, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204579}, {obj_id:279, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:291787}, {obj_id:280, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179485}, {obj_id:281, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178501}, {obj_id:282, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221016}, {obj_id:283, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175232}, {obj_id:284, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208260}, {obj_id:285, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245913}, {obj_id:286, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181184}, {obj_id:287, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190589}, {obj_id:288, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188334}, {obj_id:289, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:329246}, {obj_id:290, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198683}, {obj_id:291, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192935}, {obj_id:292, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178832}, {obj_id:293, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182899}, {obj_id:295, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:216647}, {obj_id:296, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204470}, {obj_id:299, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185775}, {obj_id:300, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187368}, {obj_id:301, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198047}, {obj_id:303, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:242606}, {obj_id:304, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187927}, {obj_id:305, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192957}, {obj_id:306, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184342}, {obj_id:307, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181545}, {obj_id:308, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196803}, {obj_id:310, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194410}, {obj_id:311, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:520573}, {obj_id:313, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:237473}, {obj_id:314, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:206322}, {obj_id:315, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210628}, {obj_id:317, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:192244}, {obj_id:318, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209224}, {obj_id:321, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:227757}, {obj_id:322, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203487}, {obj_id:323, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212894}, {obj_id:325, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184463}, {obj_id:326, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:212591}, {obj_id:329, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198823}, {obj_id:330, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181479}, {obj_id:331, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190894}, {obj_id:333, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179269}, {obj_id:335, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176445}, {obj_id:336, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184499}, {obj_id:339, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183209}, {obj_id:341, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179349}, {obj_id:342, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176712}, {obj_id:343, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:193156}, {obj_id:344, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178392}, {obj_id:346, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:178968}, {obj_id:347, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194623}, {obj_id:366, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:211096}, {obj_id:379, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156417}, {obj_id:380, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156418}, {obj_id:381, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177598}, {obj_id:382, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177593}, {obj_id:383, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186784}, {obj_id:384, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181518}, {obj_id:386, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209700}, {obj_id:389, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:390, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173008}, {obj_id:392, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:393, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204690}, {obj_id:394, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:397, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173408}, {obj_id:406, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:204343}, {obj_id:432, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196000}, {obj_id:433, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:330125}, {obj_id:434, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176970}, {obj_id:435, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173296}, {obj_id:436, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181755}, {obj_id:437, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:173728}, {obj_id:438, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187032}, {obj_id:439, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187290}, {obj_id:440, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174708}, {obj_id:441, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:302071}, {obj_id:442, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194344}, {obj_id:443, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188122}, {obj_id:444, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181760}, {obj_id:445, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221676}, {obj_id:452, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174128}, {obj_id:453, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174144}, {obj_id:454, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:209352}, {obj_id:455, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:231810}, {obj_id:456, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:230562}, {obj_id:457, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:236270}, {obj_id:458, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:259714}, {obj_id:460, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190434}, {obj_id:461, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:220714}, {obj_id:473, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156527}, {obj_id:474, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183222}, {obj_id:475, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:274325}, {obj_id:476, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183537}, {obj_id:477, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:188813}, {obj_id:478, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183918}, {obj_id:479, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:190912}, {obj_id:480, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283856}, {obj_id:481, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:223538}, {obj_id:482, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181252}, {obj_id:483, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:195339}, {obj_id:484, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:210761}, {obj_id:485, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197615}, {obj_id:486, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:248530}, {obj_id:487, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:327894}, {obj_id:488, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:321903}, {obj_id:489, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:245763}, {obj_id:490, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:491, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203366}, {obj_id:492, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174320}, {obj_id:493, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:494, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:495, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180859}, {obj_id:496, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176832}, {obj_id:497, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:498, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197057}, {obj_id:499, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175336}, {obj_id:500, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180608}, {obj_id:501, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176669}, {obj_id:505, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:191005}, {obj_id:506, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:196244}, {obj_id:507, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175722}, {obj_id:526, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:165876}, {obj_id:527, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:161699}, {obj_id:528, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:156559}, {obj_id:529, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179724}, {obj_id:530, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:283936}, {obj_id:531, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:208018}, {obj_id:532, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184393}, {obj_id:533, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:179448}, {obj_id:534, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:158701}, {obj_id:535, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:228670}, {obj_id:536, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197745}, {obj_id:537, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:183261}, {obj_id:538, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:199650}, {obj_id:539, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177090}, {obj_id:540, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:187791}, {obj_id:541, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182515}, {obj_id:552, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:217061}, {obj_id:553, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180805}, {obj_id:554, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:194136}, {obj_id:555, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177045}, {obj_id:556, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:174968}, {obj_id:560, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:203325}, {obj_id:561, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182624}, {obj_id:577, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221228}, {obj_id:578, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180394}, {obj_id:579, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:200864}, {obj_id:583, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:180160}, {obj_id:584, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185454}, {obj_id:585, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:221197}, {obj_id:602, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:182988}, {obj_id:603, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:278831}, {obj_id:604, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:198714}, {obj_id:605, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:295181}, {obj_id:606, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:186687}, {obj_id:607, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:281029}, {obj_id:608, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:181691}, {obj_id:609, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:176843}, {obj_id:610, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:175480}, {obj_id:611, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177152}, {obj_id:612, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:184453}, {obj_id:665, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:197084}, {obj_id:666, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:185685}, {obj_id:703, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177605}, {obj_id:704, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:177585}, {obj_id:705, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:160137}, {obj_id:706, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:205550}, {obj_id:707, tenant_id:1, log_del_time:9223372036854775807, real_del_time:9223372036854775807, ref_count:2, added_to_lc:true, mem_used:233680}]) [2025-04-21 14:09:54.958138] INFO [SQL.PC] runTimerTask (ob_plan_cache.cpp:2763) [619811][T1_PlanCacheEvi][T1][Y0-0000000000000000-0-0] [lt=728] schedule next cache evict task(evict_interval=5000000) [2025-04-21 14:09:54.961685] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=63] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:54.964474] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=19] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:54.964576] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=83] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=9, avg_log_batch_cnt=1, total_group_log_size=3411, avg_group_log_size=379) [2025-04-21 14:09:54.964610] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=27] [PALF STAT APPEND COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:54.966365] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=64] current monitor number(seq_=-1) [2025-04-21 14:09:54.980794] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=30] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:54.980881] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=79] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:54.982141] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE1F-0-0] [lt=36] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:54.982241] INFO [MDS] for_each_ls_in_tenant (mds_tenant_service.cpp:241) [619778][T1_Occam][T1][YB420B1D7AB6-00063343ACDEFE21-0-0] [lt=56] for each ls(succ_num=1, ret=0, ret="OB_SUCCESS") [2025-04-21 14:09:54.990413] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C4-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:54.995134] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C6-0-0] [lt=84][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.006359] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=54][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.031261] INFO [PALF] try_recycle_blocks (palf_env_impl.cpp:805) [620086][T1001_PalfGC][T1001][Y0-0000000000000000-0-0] [lt=84] LOG_DISK_OPTION(disk_options_wrapper_={disk_opts_for_stopping_writing:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):614, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):89, sequence:1}) [2025-04-21 14:09:55.043125] INFO [SERVER] try_reload_schema (ob_server_schema_updater.cpp:447) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=20] schedule fetch new schema task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:55.043158] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:262) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDCA-0-0] [lt=23] [REFRESH_SCHEMA] start to process schema refresh task(ret=0, ret="OB_SUCCESS", schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:55.043203] INFO [SERVER] do_heartbeat_event (ob_heartbeat.cpp:269) [620351][LeaseHB][T0][Y0-0000000000000000-0-0] [lt=77] try reload schema success(schema_version=1745215630089560, refresh_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_ret=0) [2025-04-21 14:09:55.043216] INFO [SERVER] process_refresh_task (ob_server_schema_updater.cpp:287) [619547][SerScheQueue1][T0][YB420B1D7AB6-00063343B56EFDCA-0-0] [lt=50] [REFRESH_SCHEMA] local schema info is newer, no need to refresh schema(ret=0, ret="OB_SUCCESS", local_schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}, schema_info={schema_version:1745215651966856, tenant_id:1002, sequence_id:3298534883998}) [2025-04-21 14:09:55.044890] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=47] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:55.063996] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=22] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=51589939, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=555724800, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=518017024, wash_ratio=6, tenant_id=1001) [2025-04-21 14:09:55.064125] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=74] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:55.064160] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1001][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=310, drift_size_=0, pre_drift_size=-14697152, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1001, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:55.064242] INFO [SQL.ENG] get_max_work_area_size (ob_tenant_sql_memory_manager.cpp:944) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=28] trace max work area(auto_calc=true, tenant_max_memory_limit=1073741824, total_alloc_size=0, tenant_work_area_memory_hold=0, tenant_work_area_max_size=53687091, max_wa_memory_size=53687091, tmp_max_wa_memory_size=53687091, pre_mem_target=53687091, remain_memory_size=53687091, ratio=-nan, alloc_ratio=0.000000000000000000e+00, hold_ratio=0.000000000000000000e+00, tenant_memory_hold=664494080, washable_size=-2, max_workarea_memory_size=53687091, max_tenant_memory_size=409247744, wash_ratio=6, tenant_id=1002) [2025-04-21 14:09:55.064314] INFO [SQL.ENG] calculate_global_bound_size (ob_tenant_sql_memory_manager.cpp:310) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=32] timer to calc global bound size(ret=0, best_interval_idx=1099, global_bound_size_=6710886, calc_global_bound_size=1048576000000, mem_target_=53687091, wa_max_memory_size=53687091, profile_cnt_=0, total_memory_size=0, max_wa_size=53687091, avg_bound_size=6710886, max_bound_size=6710886, min_bound_size_=1048576) [2025-04-21 14:09:55.064352] INFO [SQL.ENG] calculate_global_bound_size_by_interval_info (ob_tenant_sql_memory_manager.cpp:1192) [619487][SqlMemTimer][T1002][Y0-0000000000000000-0-0] [lt=37] timer to calc global bound size(ret=0, global_bound_size_=6710886, manual_calc_cnt_=32, drift_size_=0, pre_drift_size=0, wa_max_memory_size=53687091, sql_mem_callback_.get_total_alloc_size()=0, tenant_id_=1002, profile_cnt_=0, pre_profile_cnt_=0, pre_profile_cnt=0, calc_info.get_global_bound_size()=6710886, total_memory_size=0, cur_profile_cnt=0, calc_info.get_mem_target()=53687091, auto_calc=true, sql_mem_callback_.get_total_dump_size()=0) [2025-04-21 14:09:55.084806] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04C9-0-0] [lt=104][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.085455] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04CA-0-0] [lt=51][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.098619] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=62] PNIO [ratelimit] time: 1745215795098614, bytes: 5530313, bw: 0.013783 MB/s, add_ts: 1003553, add_bytes: 14504 [2025-04-21 14:09:55.104374] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=8318976) [2025-04-21 14:09:55.104446] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=62] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.106429] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=76][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.114638] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [619794][T1_LogLoop][T1][Y0-0000000000000000-0-0] [lt=113] LogLoopThread round_cost_time(us)(round_cost_time=35) [2025-04-21 14:09:55.120913] INFO [SHARE] update_decay_factor_ (ob_throttle_unit.ipp:284) [620163][T1001_TenantWea][T1001][YB420B1D7AB6-00063343B1DF00EF-0-0] [lt=44] [Throttle] Update Throttle Unit Config(is_adaptive_update=true, N=7.965794944763183594e+01, this=0x7f3c4d857208, enable_adaptive_limit_=true, Unit Name=TxShare, Config Specify Resource Limit(MB)=511, Resource Limit(MB)=398, Throttle Trigger(MB)=238, Throttle Percentage=60, Max Duration(us)=7200000000, Decay Factor=6.976536714288150733e+02) [2025-04-21 14:09:55.121340] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=73] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=7887, avg_group_log_size=606) [2025-04-21 14:09:55.121395] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c3efed410, extra_info="id:1") [2025-04-21 14:09:55.123045] INFO [LIB] stat (utility.h:1176) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=53] [PALF STAT WRITE LOG COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1385, this=0x7f3c4a4d5bb0, extra_info="") [2025-04-21 14:09:55.123096] INFO [LIB] stat (utility.h:1193) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=37] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c4a3b0530, extra_info="") [2025-04-21 14:09:55.123184] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=14, this=0x7f3c4a4cb6a0, extra_info="palf_id:1") [2025-04-21 14:09:55.123250] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=65] [PALF STAT LOG LIFE TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1527, this=0x7f3c4a4cb8d0, extra_info="palf_id:1") [2025-04-21 14:09:55.123280] INFO [LIB] stat (utility.h:1176) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=15] [PALF STAT FLUSH CB COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=56, this=0x7f3c4a4d5de0, extra_info="") [2025-04-21 14:09:55.123401] INFO [STORAGE.TRANS] persist_version_if_need_ (ob_tenant_weak_read_cluster_service.cpp:336) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=24] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] persist CLUSTER version range succ(tenant_id=1001, new_min_version={val:1745215794919626000, v:0}, new_max_version={val:1745215794919626000, v:0}, last_min_version={val:1745215794719140000, v:0}, last_max_version={val:1745215794719140000, v:0}, total_time_us=4689, delta_us=203772) [2025-04-21 14:09:55.123457] INFO [STORAGE.TRANS] update_cluster_version (ob_tenant_weak_read_cluster_service.cpp:695) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=52] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] update version(tenant_id=1001, current_version={val:1745215794919626000, v:0}, min_version={val:1745215794919626000, v:0}, max_version={val:1745215794919626000, v:0}, in_service=true, leader_epoch=3) [2025-04-21 14:09:55.136066] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=0) [2025-04-21 14:09:55.151025] INFO [LIB] stat (utility.h:1176) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1458, this=0x7f3c35741bb0, extra_info="") [2025-04-21 14:09:55.151089] INFO [LIB] stat (utility.h:1193) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=53] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=32, this=0x7f3c359b0530, extra_info="") [2025-04-21 14:09:55.151116] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=15] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:55.151156] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=14] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=13, this=0x7f3c357376a0, extra_info="palf_id:1") [2025-04-21 14:09:55.151198] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=41] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1592, this=0x7f3c357378d0, extra_info="palf_id:1") [2025-04-21 14:09:55.151239] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=62, this=0x7f3c35741de0, extra_info="") [2025-04-21 14:09:55.162163] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=48] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:55.165812] INFO [LIB] stat (utility.h:1176) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT WRITE LOG COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1543, this=0x7f3c6c7c5bb0, extra_info="") [2025-04-21 14:09:55.165875] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=60] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=3412) [2025-04-21 14:09:55.165926] INFO [LIB] stat (utility.h:1193) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=38, this=0x7f3c67fa9830, extra_info="") [2025-04-21 14:09:55.165954] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=17] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=3412) [2025-04-21 14:09:55.166017] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=47] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=9, this=0x7f3c6c7bb6a0, extra_info="palf_id:1") [2025-04-21 14:09:55.166042] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=24] [PALF STAT LOG LIFE TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=1689, this=0x7f3c6c7bb8d0, extra_info="palf_id:1") [2025-04-21 14:09:55.166062] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=18] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=9, avg_log_gen_to_freeze_time=8, avg_log_gen_to_submit_time=36, avg_log_submit_to_flush_time=1631, avg_log_submit_to_slide_time=1652) [2025-04-21 14:09:55.166098] INFO [LIB] stat (utility.h:1176) [619788][T1_LogIOCb0][T1][Y0-0000000000000000-0-0] [lt=25] [PALF STAT FLUSH CB COST TIME](cur_stat_count=9, stat_interval=1000000, avg (count/cost)=50, this=0x7f3c6c7c5de0, extra_info="") [2025-04-21 14:09:55.166139] INFO [PALF] read (log_cache.cpp:103) [619791][T1_LogSharedQue][T1][Y0-0000000000000000-0-0] [lt=36] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=3412, hit_cnt=9, read_cnt=9, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:55.180268] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=23] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=7887) [2025-04-21 14:09:55.180335] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620082][T1001_LogIOCb0][T1001][Y0-0000000000000000-0-0] [lt=45] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=13, avg_log_gen_to_freeze_time=6, avg_log_gen_to_submit_time=25, avg_log_submit_to_flush_time=1457, avg_log_submit_to_slide_time=1477) [2025-04-21 14:09:55.190656] INFO eloop_run (eloop.c:140) [619534][pnio2][T0][Y0-0000000000000000-0-0] [lt=50] PNIO [ratelimit] time: 1745215795190650, bytes: 0, bw: 0.000000 MB/s, add_ts: 1007612, add_bytes: 0 [2025-04-21 14:09:55.206503] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.215397] INFO [SERVER] refresh_avail_memory (ob_table_load_assigned_memory_manager.cpp:117) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=43] ObTableLoadAssignedMemoryManager::refresh_avail_memory(MTL_ID()=1, avail_memory=268435456, chunk_count_=0, avail_sort_memory_=268435456, avail_memory_=268435456) [2025-04-21 14:09:55.215471] INFO [STORAGE] publish_scn (ob_replica_safe_check_task.cpp:295) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=41] publish_scn finish(ret=0, ret="OB_SUCCESS", need_publish=false, major_mv_merge_scn={val:18446744073709551615, v:3}, lastest_merge_scn={val:18446744073709551615, v:3}, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}, ls_attr_array=[]) [2025-04-21 14:09:55.215521] INFO [STORAGE] switch_status (ob_replica_safe_check_task.cpp:195) [619837][T1_TntSharedTim][T1][Y0-0000000000000000-0-0] [lt=46] replica safe check task switch_status(ret=0, ret="OB_SUCCESS", new_status=0, delay=30000000, this={status:0, in_sched:true, is_stop:false, is_inited:true, merge_scn:{val:18446744073709551615, v:3}, max_transfer_task_id:{id:-1}, ls_cache:{arr_.count():0, arr:[]}}) [2025-04-21 14:09:55.251086] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT LOG TASK TIME](palf_id=1001, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=2, avg_log_gen_to_submit_time=13, avg_log_submit_to_flush_time=1500, avg_log_submit_to_slide_time=1525) [2025-04-21 14:09:55.251115] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=18] [APPLY STAT CB APPEND COST TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=36, this=0x7f3c24966280, extra_info="") [2025-04-21 14:09:55.251169] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=53] [APPLY STAT CB IN QUEUE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1648, this=0x7f3c249664b0, extra_info="") [2025-04-21 14:09:55.251190] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=19] [APPLY STAT CB WAIT COMMIT TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=0, this=0x7f3c249666e0, extra_info="") [2025-04-21 14:09:55.251195] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=81] [PALF STAT COMMITTED LOG SIZE](palf_id=1, self="11.29.122.182:2882", committed size=1226) [2025-04-21 14:09:55.251205] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=13] [APPLY STAT CB EXECUTE TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=-597, this=0x7f3c24966910, extra_info="") [2025-04-21 14:09:55.251219] INFO [LIB] stat (utility.h:1176) [620269][T1002_ApplySrv0][T1002][YB420B1D7AB6-00063343B76F0495-0-0] [lt=13] [APPLY STAT CB TOTAL TIME](cur_stat_count=21, stat_interval=5000000, avg (count/cost)=1087, this=0x7f3c24966b40, extra_info="") [2025-04-21 14:09:55.251225] INFO [PALF] sliding_cb (log_sliding_window.cpp:2291) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT LOG TASK TIME](palf_id=1, self="11.29.122.182:2882", total_slide_log_cnt=10, avg_log_gen_to_freeze_time=7, avg_log_gen_to_submit_time=29, avg_log_submit_to_flush_time=1538, avg_log_submit_to_slide_time=1558) [2025-04-21 14:09:55.251278] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT HOT CACHE HIT RATE](palf_id=1001, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:55.261736] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF3-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.264461] INFO [SERVER] check_new_jobs (ob_dbms_sched_job_master.cpp:531) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=37] check new jobs(ret=0, tenant_id=1, is_oracle_tenant=false, job_infos=[{tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:9, job_name_:"ASYNC_GATHER_STATS_JOB_PROC", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745215635226715, start_date_:1745214895995330, last_date_:1745214895996980, this_date_:0, next_date_:1745215795995330, end_date_:64060560000000000, total_:739229735, interval_:"FREQ=MINUTELY; INTERVAL=15", repeat_interval_:"FREQ=MINUTELY; INTERVAL=15", failures_:1, flag_:0, what_:"DBMS_STATS.ASYNC_GATHER_STATS_JOB_PROC(600000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:600, interval_ts_:900000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:5, job_name_:"FRIDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745589600000000, last_date_:0, this_date_:0, next_date_:1745589600000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:1, job_name_:"MONDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745244000000000, last_date_:0, this_date_:0, next_date_:1745244000000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:8, job_name_:"OPT_STATS_HISTORY_MANAGER", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745300395995219, last_date_:0, this_date_:0, next_date_:1745300395995219, end_date_:64060560000000000, total_:0, interval_:"FREQ=DAYLY; INTERVAL=1", repeat_interval_:"FREQ=DAYLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.PURGE_STATS(NULL)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:43200, interval_ts_:86400000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:6, job_name_:"SATURDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745618400000000, last_date_:0, this_date_:0, next_date_:1745618400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:7, job_name_:"SUNDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745704800000000, last_date_:0, this_date_:0, next_date_:1745704800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(72000000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:72000, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:4, job_name_:"THURSDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745503200000000, last_date_:0, this_date_:0, next_date_:1745503200000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:2, job_name_:"TUESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745330400000000, last_date_:0, this_date_:0, next_date_:1745330400000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}, {tenant_id_:1, user_id_:18446744073709551615, database_id_:18446744073709551615, job_:3, job_name_:"WEDNESDAY_WINDOW", lowner_:"root@%", powner_:"root@%", cowner_:"oceanbase", last_modify_:1745213996003363, start_date_:1745416800000000, last_date_:0, this_date_:0, next_date_:1745416800000000, end_date_:64060560000000000, total_:0, interval_:"FREQ=WEEKLY; INTERVAL=1", repeat_interval_:"FREQ=WEEKLY; INTERVAL=1", failures_:0, flag_:0, what_:"DBMS_STATS.GATHER_DATABASE_STATS_JOB_PROC(14400000000)", nlsenv_:"", charenv_:"", field1_:"", scheduler_flags_:0, enabled_:true, auto_drop_:false, max_run_duration_:14400, interval_ts_:604800000000}]) [2025-04-21 14:09:55.264596] INFO [SERVER] check_tenant (ob_dbms_sched_job_master.cpp:520) [620001][T1_DBMSSched][T1][Y0-0000000000000000-0-0] [lt=134] check all tenants(ret=0) [2025-04-21 14:09:55.265980] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF6-0-0] [lt=15] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.266654] INFO [SHARE] force_set_master_rs (ob_rs_mgr.cpp:277) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDE0-0-0] [lt=44] [RS_MGR] force set rs list(master_rs="11.29.122.182:2882") [2025-04-21 14:09:55.266726] INFO [SERVER] handle_heartbeat (ob_service.cpp:3771) [620405][T1_L0_G25][T1][YB420B1D7AB6-00063343B0EEFDE0-0-0] [lt=63] handle_heartbeat(ret=0, ret="OB_SUCCESS", hb_request={server:"11.29.122.182:2882", server_id:1, rs_addr:"11.29.122.182:2882", rs_server_status:1, epoch_id:3}, hb_response={zone:"zone1", server:"11.29.122.182:2882", sql_port:2881, build_version:"4.3.4.1_101000032024121814-50c70ec9b4360352607cbed6587000307b82694e(Dec 18 2024 16:09:45)", start_service_time:1745215621947340, server_health_status:{data_disk_status_:1, data_disk_status:"NORMAL"}}, time_cost=84) [2025-04-21 14:09:55.267029] INFO [STORAGE.TRANS] operator() (ob_ts_mgr.h:180) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=46] refresh gts functor(ret=0, ret="OB_SUCCESS", gts_tenant_info={v:1}) [2025-04-21 14:09:55.267333] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF7-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.268696] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF8-0-0] [lt=52] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.270029] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDF9-0-0] [lt=34] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.271323] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDFA-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.272614] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDFB-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.273903] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDFC-0-0] [lt=35] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:55.306571] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=47][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.318811] INFO [STORAGE.TRANS] print_stat_ (ob_tenant_weak_read_service.cpp:540) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=34] [WRS] [TENANT_WEAK_READ_SERVICE] [STAT](tenant_id=1001, server_version={version:{val:1745215795120258000, v:0}, total_part_count:1, valid_inner_part_count:1, valid_user_part_count:0}, server_version_delta=198543, in_cluster_service=true, cluster_version={val:1745215794919626000, v:0}, min_cluster_version={val:1745215794919626000, v:0}, max_cluster_version={val:1745215794919626000, v:0}, get_cluster_version_err=0, cluster_version_delta=399175, cluster_service_master="11.29.122.182:2882", cluster_service_tablet_id={id:226}, post_cluster_heartbeat_count=1705, succ_cluster_heartbeat_count=1, cluster_heartbeat_interval=50000, local_cluster_version={val:1745215665179407000, v:0}, local_cluster_delta=130139394, force_self_check=false, weak_read_refresh_interval=100000) [2025-04-21 14:09:55.321700] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620083][T1001_IOWorker][T1001][Y0-0000000000000000-0-0] [lt=16] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=7888) [2025-04-21 14:09:55.321863] INFO [PALF] read (log_cache.cpp:103) [620085][T1001_LogShared][T1001][Y0-0000000000000000-0-0] [lt=46] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=7888, hit_cnt=13, read_cnt=13, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:55.341092] INFO [COMMON] replace_fragment_node (ob_kvcache_map.cpp:728) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=49] Cache replace map node details(ret=0, replace_node_count=0, replace_time=0, replace_start_pos=8900000, replace_num=100000) [2025-04-21 14:09:55.341141] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=47] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=10) [2025-04-21 14:09:55.362641] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=54] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:55.362816] INFO [SHARE] load_can_execute_task (ob_balance_task_table_operator.cpp:842) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE34-0-0] [lt=57] load can-execute balance task(ret=0, ret="OB_SUCCESS", task_array=[], sql=select * from __all_balance_task where parent_list is null or parent_list = '') [2025-04-21 14:09:55.362870] INFO [BALANCE] do_work (ob_balance_task_execute_service.cpp:172) [620234][T1002_BalanceEx][T1002][YB420B1D7AB6-00063343B53EFE34-0-0] [lt=50] [BALANCE_EXECUTE] finish one round(ret=0, ret="OB_SUCCESS", task_array_=[], idle_time_us=1000000, task_comment_=) [2025-04-21 14:09:55.378840] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=39] success to update min reserved snapshot(reserved_snapshot=1745213985621567000, duration=1800, snapshot_gc_ts=1745215785621567000) [2025-04-21 14:09:55.378905] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:760) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] success to update min reserved snapshot(reserved_snapshot=1745213988818388000, duration=1800, snapshot_gc_ts=1745215788818388000) [2025-04-21 14:09:55.380315] INFO [STORAGE] update_min_reserved_snapshot_for_leader (ob_ls_reserved_snapshot_mgr.cpp:191) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=42] submit reserved snapshot log success(ls_id={id:1}, new_snapshot_version=1745213988818388000) [2025-04-21 14:09:55.380364] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [620118][T1001_FreInfoRe][T1001][Y0-0000000000000000-0-0] [lt=44] update reserved snapshot finished(cost_ts=1462, reserved_snapshot=1745213988818388000) [2025-04-21 14:09:55.380439] INFO [STORAGE] try_update_reserved_snapshot (ob_tenant_freeze_info_mgr.cpp:787) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=41] update reserved snapshot finished(cost_ts=1601, reserved_snapshot=1745213985621567000) [2025-04-21 14:09:55.399429] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=0, size_used=0, mem_used=79030272) [2025-04-21 14:09:55.399485] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=48] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.406645] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.416618] INFO [SQL.QRR] runTimerTask (ob_udr_mgr.cpp:93) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=40] run rewrite rule refresh task(rule_mgr_->tenant_id_=1) [2025-04-21 14:09:55.418609] INFO [SQL.PC] need_check_schema_version (ob_plan_cache_value.cpp:2322) [619831][T1_ReqMemEvict][T1][YB420B1D7AB6-00063343AD9EFDAC-0-0] [lt=56] need check schema(new_schema_version=1745215630089560, cached_tenant_schema_version=1745215630089560, is_contain_synonym()=false, contain_sys_name_table_=true, is_contain_tmp_tbl()=false, is_contain_sys_pl_object()=false, pc_ctx.sql_ctx_.session_info_->get_has_temp_table_flag()=false, need_check=true, constructed_sql_=SELECT VALUE FROM __all_sys_stat WHERE ZONE = ? AND NAME = ? AND TENANT_ID = ? FOR UPDATE) [2025-04-21 14:09:55.419236] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619831][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=62] get number(ret=0, service_type_=0, range=1, base_id=1745215795418602000, start_id=1745215795418602000, end_id=1745215795418602001) [2025-04-21 14:09:55.423004] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=68] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=4070) [2025-04-21 14:09:55.424630] INFO [PALF] inner_write_once_ (log_block_handler.cpp:412) [619789][T1_IOWorker][T1][Y0-0000000000000000-0-0] [lt=30] [PALF STAT WRITE LOG INFO TO DISK](ret=0, offset=66027028, this={dio_aligned_buf:{buf_write_offset:53, buf_padding_size:4043, align_size:4096, aligned_buf_size:3682304, aligned_used_ts:4646, truncate_used_ts:1941}, log_block_size:67108864, dir_fd:130, io_fd:131}, aligned_buf_len=8192, aligned_block_offset=66023424, buf_len=545, total_write_size=38004, total_write_size_after_dio=446464, ob_pwrite_used_ts=185428, count=99, each_pwrite_cost=1873) [2025-04-21 14:09:55.425422] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620169][T1001_LSArchive][T1001][YB420B1D7AB6-00063343AD3EFD86-0-0] [lt=56] gc stale ls task succ [2025-04-21 14:09:55.425874] INFO [STORAGE.TRANS] self_check (ob_tenant_weak_read_cluster_service.cpp:831) [619978][T1_TenantWeakRe][T1][Y0-0000000000000000-0-0] [lt=39] [WRS] [TENANT_WEAK_READ_SERVICE] [CLUSTER_SERVICE] [SELF_CHECK] done(ret=0, ret="OB_SUCCESS", tenant_id=1, need_start_service=false, need_stop_service=false, need_change_leader=false, is_in_service()=true, can_update_version=true, cur_leader_epoch=3, start_service_tstamp_=1745215615859075, error_count_for_change_leader_=0, last_error_tstamp_for_change_leader_=0) [2025-04-21 14:09:55.442981] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620179][T1001_HAService][T1001][Y0-0000000000000000-0-0] [lt=43] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:55.445560] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:179) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=46] tmp file swap statistics(swap_task_cnt=0, avg_swap_response_time=0, max_swap_response_time=-1, min_swap_response_time=-1) [2025-04-21 14:09:55.445642] INFO [STORAGE] print_block_usage (ob_tmp_file_block_manager.cpp:822) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=71] temporary file module use no blocks [2025-04-21 14:09:55.445670] INFO [STORAGE] print_statistics (ob_tmp_file_thread_job.cpp:125) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=26] tmp file flush statistics(flush_task_cnt=0, avg_flush_data_len=0, max_flush_data_len=-1, min_flush_data_len=-1, f1_cnt=0, f2_cnt=0, f3_cnt=0, f4_cnt=0, f5_cnt=0) [2025-04-21 14:09:55.445699] INFO [STORAGE] print_statistics (ob_tmp_file_write_buffer_pool.cpp:1094) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=25] tmp file write buffer pool statistics(dirty_page_percentage=0, max_page_num=1518, dirty_page_num=0, total_write_back_num=0, meta_page_num=0, dirty_meta_page_num=0, write_back_meta_num=0, data_page_num=0, dirty_data_page_num=0, write_back_data_num=0, data_page_watermark=0, meta_page_watermark=0) [2025-04-21 14:09:55.445718] INFO [STORAGE] do_work_ (ob_tmp_file_thread_wrapper.cpp:308) [620148][T1001_TFSwap][T1001][Y0-0000000000000000-0-0] [lt=18] ObTmpFileFlushTG information(this={is_inited_:true, mode_:1, last_flush_timestamp_:254999995782, flush_io_finished_ret_:0, flush_io_finished_round_:187, flushing_block_num_:0, is_fast_flush_meta_:false, fast_flush_meta_task_cnt_:0, wait_list_size_:0, retry_list_size_:0, finished_list_size_:0, normal_loop_cnt_:1, normal_idle_loop_cnt_:1, fast_loop_cnt_:0, fast_idle_loop_cnt_:0, flush_mgr_:{is_inited_:true, flush_ctx_:{is_inited_:true, fail_too_many_:false, expect_flush_size_:0, actual_flush_size_:0, flush_seq_ctx_:{create_flush_task_cnt_:0, prepare_finished_cnt_:0, flush_sequence_:0}, state_:5, iter_:{is_inited_:false, cur_caching_list_idx_:0, cur_caching_list_is_meta_:false, cur_iter_dir_idx_:-1, cur_iter_file_idx_:-1, cached_file_num_:0, cached_dir_num_:0}}}}) [2025-04-21 14:09:55.450009] INFO [COMMON] print_status (ob_io_manager.cpp:288) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS SERVER] net_in=13kB/s, net_out=13kB/s, bucket_in=0kB/s, bucket_out=0kB/s, failed_bucket_in=0kB/s, failed_bucket_out=0kB/s, limit=128000kB/s [2025-04-21 14:09:55.450092] INFO [COMMON] print_sender_status (ob_io_manager.cpp:907) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=43] [IO STATUS SENDER](io_status=req_in_sender, total=0, total_local_read=0, total_local_write=0, total_remote_read=0, total_remote_write=0, cnt=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , local_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_read=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 , remote_write=0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 ) [2025-04-21 14:09:55.450301] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=40] [IO STATUS CALLBACK](tenant_id=1, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:340, idx_:0, tid_:619839}], io_callback_status=runner 0: thread_id=619839, queue_count=0, ) [2025-04-21 14:09:55.450527] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=53] [IO STATUS CALLBACK](tenant_id=1001, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:398, idx_:0, tid_:620126}], io_callback_status=runner 0: thread_id=620126, queue_count=0, ) [2025-04-21 14:09:55.450638] INFO [COMMON] print_io_status (ob_io_manager.cpp:2186) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=26] [IO STATUS GROUP SYS](tenant_id=1002, io_status=sys_group_name:CALIBRATION_IO, mode:LOCAL WRITE, cur_req:0, hold_mem:0 [FAILED]: fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]: size:4096, iops:2, bw:8174, [delay/us]:prepare:17, schedule:43, submit:10, rt:1413, total:1483) [2025-04-21 14:09:55.450768] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=67] [IO STATUS TENANT](tenant_id=1002, ref_cnt=2, io_config={group_configs_cnt:3, memory_limit_:1073741824, callback_thread_count_:0, unit_config_:{min_iops:9223372036854775807, max_iops:9223372036854775807, weight:1, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:1}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:0, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=9223372036854775807, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:55.450840] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=63] [IO STATUS FUNCTION](tenant_id=1002, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL WRITE, avg_size:4096, avg_iops:2, avg_bw:8173, [delay/us]: prepare:17, schedule:43, submit:10, device:1413, total:1483) [2025-04-21 14:09:55.450909] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS CALLBACK](tenant_id=1002, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:456, idx_:0, tid_:620264}], io_callback_status=runner 0: thread_id=620264, queue_count=0, ) [2025-04-21 14:09:55.450986] INFO [COMMON] print_io_status (ob_io_manager.cpp:2089) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=20] [IO STATUS GROUP](tenant_id=500, io_status=group_id:0, group_name:OTHER_GROUPS, mode:LOCAL READ, cur_req:0, hold_mem:0 [FAILED]:fail_size:0, fail_iops:0, fail_bw:0, [delay/us]:prepare:0, schedule:0, submit:0, rt:0, total:0, [SUCC]:size:4096, iops:1, bw:4086, limit:50000, [delay/us]:prepare:0, schedule:0, submit:600000000, rt:747, total:764) [2025-04-21 14:09:55.451064] INFO [COMMON] print_io_status (ob_io_manager.cpp:2216) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=18] [IO STATUS TENANT](tenant_id=500, ref_cnt=1, io_config={group_configs_cnt:3, memory_limit_:536870912, callback_thread_count_:0, unit_config_:{min_iops:10000, max_iops:50000, weight:10000, max_net_bandwidth:9223372036854775807, net_bandwidth_weight:100}, enable_io_tracer:false, object_storage_io_timeout_ms:20000, group_configs:[group_id = 0:{mode:0, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:1, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}, group_id = 0:{mode:2, deleted:false, cleared:false, min_percent:100, max_percent:100, weight_percent:100}]}, hold_mem=28568256, free_req_cnt=50000, free_result_cnt=50000, callback_queues=[0], [FAILED]: fail_ips=0, fail_ops=0, fail_iops=0, fail_ibw=0, fail_obw=0, [SUCC]: ips=0, ops=0, iops=0, ibw=0, obw=0, iops_limit=50000, ibw_limit=9223372036854775807, obw_limit=9223372036854775807) [2025-04-21 14:09:55.451117] INFO [COMMON] print_io_function_status (ob_io_manager.cpp:2296) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=47] [IO STATUS FUNCTION](tenant_id=500, io_status=function_name:DEFAULT_FUNCTION, mode:LOCAL READ, avg_size:4096, avg_iops:1, avg_bw:4086, [delay/us]: prepare:0, schedule:0, submit:600000000, device:747, total:764) [2025-04-21 14:09:55.451201] INFO [COMMON] print_io_status (ob_io_manager.cpp:2238) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=19] [IO STATUS CALLBACK](tenant_id=500, runners=[{is_inited_:true, queue_.get_total():0, tg_id_:285, idx_:0, tid_:619660}], io_callback_status=runner 0: thread_id=619660, queue_count=0, ) [2025-04-21 14:09:55.451232] INFO [COMMON] print_status (ob_io_struct.cpp:2759) [619661][IO_TUNING0][T0][Y0-0000000000000000-0-0] [lt=22] [IO STATUS CHANNEL] req_in_channel, sync_total=0, async_total=0, sync_cnt= 0 0 0 0 0 0 0 0, async_cnt= 0 [2025-04-21 14:09:55.451297] INFO [PALF] try_advance_committed_lsn_ (log_sliding_window.cpp:1771) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=21] [PALF STAT COMMITTED LOG SIZE](palf_id=1001, self="11.29.122.182:2882", committed size=1220) [2025-04-21 14:09:55.475541] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619635][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.475605] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619633][RpcIO][T0][Y0-0000000000000000-0-0] [lt=26] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.475713] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619636][RpcIO][T0][Y0-0000000000000000-0-0] [lt=37] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.475972] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619634][RpcIO][T0][Y0-0000000000000000-0-0] [lt=40] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.481041] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:55.481102] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=54] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.497162] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=39] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1002, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:55.498377] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=48] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:55.498476] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [620256][T1002_FreInfoRe][T1002][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215791239977000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:55.506718] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=57][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.509884] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=43] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4157, offset=103716}, end_cursor:ObLogCursor{file_id=3, log_id=4158, offset=104022}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778c4050, len:2780, log_data_len:306, seq:4157, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:55.510230] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE97-0-0] [lt=31] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}) [2025-04-21 14:09:55.510296] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE97-0-0] [lt=40] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215795266728001, v:0}, arg={tenant_id:1002, ls_id:{id:1}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1}, cur_readable_scn:{val:1745215795266728001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:55.511931] WDIAG [ARCHIVE] do_thread_task_ (ob_archive_sender.cpp:257) [619987][T1_ArcSender][T1][YB420B1D7AB6-00063343AC7EFD86-0-0] [lt=77][errcode=-4018] try free send task failed(ret=-4018) [2025-04-21 14:09:55.516232] INFO [STORAGE.REDO] notify_flush (ob_storage_log_writer.cpp:552) [620278][T1002_OB_SLOG][T1002][Y0-0000000000000000-0-0] [lt=53] Successfully flush(log_item={start_cursor:ObLogCursor{file_id=3, log_id=4158, offset=104022}, end_cursor:ObLogCursor{file_id=3, log_id=4159, offset=104319}, is_inited:true, is_local:false, buf_size:8192, buf:0x7f3c778c8050, len:2474, log_data_len:297, seq:4158, flush_finish:false, flush_ret:0}) [2025-04-21 14:09:55.516654] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3696) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE97-0-0] [lt=30] start get_ls_replayed_scn(arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}) [2025-04-21 14:09:55.516723] INFO [SERVER] get_ls_replayed_scn (ob_service.cpp:3751) [624907][T1002_L0_G18][T1002][YB420B1D7AB6-00063343AEEEFE97-0-0] [lt=43] finish get_ls_replayed_scn(ret=0, ret="OB_SUCCESS", cur_readable_scn={val:1745215795266728001, v:0}, arg={tenant_id:1002, ls_id:{id:1001}, all_replica:false}, result={tenant_id:1002, ls_id:{id:1001}, cur_readable_scn:{val:1745215795266728001, v:0}, offline_scn:{val:18446744073709551615, v:3}, self_addr_:"11.29.122.182:2882"}, offline_scn={val:18446744073709551615, v:3}) [2025-04-21 14:09:55.541244] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=20] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=9) [2025-04-21 14:09:55.555009] WDIAG begin (ob_hashtable.h:954) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0227-0-0] [lt=39][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x10805f1c 0x799422f 0x7af6e6e 0x7af6db2 0x7af6db2 0x7af677d 0x7a2c460 0x7a1ee3c 0x7a1e128 0x7a1de10 0x11f70574 0x7a1d08f 0x7a15b72 0x7a10c4e 0x79ffbee 0x76a43d0 0x76a094e 0x74d3a24 0x74b8516 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.557530] WDIAG [SQL.PC] common_free (ob_lib_cache_object_manager.cpp:141) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B4AF0227-0-0] [lt=42][errcode=0] set logical del time(cache_obj->get_logical_del_time()=255001107835, cache_obj->added_lc()=false, cache_obj->get_object_id()=781, cache_obj->get_tenant_id()=1, lbt()="0x7bad295 0x10c7af38 0x74c3698 0x74b964f 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3") [2025-04-21 14:09:55.563145] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=62] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:55.579037] INFO [STORAGE] gc_tables_in_queue (ob_tenant_meta_mem_mgr.cpp:612) [620125][T1001_TenantMet][T1001][Y0-0000000000000000-0-0] [lt=88] gc tables in queue: recycle 0 table(ret=0, tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl3788EEE", sizeof(T):3824, used_obj_cnt:959, free_obj_hold_cnt:0, allocator used:3690232, allocator total:3916800}, large_tablet_buffer_pool_={typeid(T).name():"N9oceanbase7storage15ObMetaObjBufferINS0_8ObTabletELl65448EEE", sizeof(T):65480, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, full_tablet_creator_={tiny_allocator_.used():0, tiny_allocator_.total():0, full allocator used:0, full allocator total:0}, tablets_mem=3916800, tablets_mem_limit=214748360, ddl_kv_pool_={typeid(T).name():"N9oceanbase7storage7ObDDLKVE", sizeof(T):1024, used_obj_cnt:0, free_obj_hold_cnt:0, allocator used:0, allocator total:0}, memtable_pool_={typeid(T).name():"N9oceanbase8memtable10ObMemtableE", sizeof(T):1984, used_obj_cnt:57, free_obj_hold_cnt:0, allocator used:116736, allocator total:130560}, pending_cnt=0, wait_gc_count=0, tablet count=959) [2025-04-21 14:09:55.580745] INFO [STORAGE.TRANS] generate_weak_read_timestamp_ (ob_ls_wrs_handler.cpp:194) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=42] get wrs ts(ls_id={id:1}, delta=313322, log_service_ts=1745215795266728, min_tx_service_ts=4611686018427387, timestamp={val:1745215795266728001, v:0}) [2025-04-21 14:09:55.580793] INFO [STORAGE.TRANS] print_stat_info (ob_keep_alive_ls_handler.cpp:225) [620303][T1002_TenantWea][T1002][Y0-0000000000000000-0-0] [lt=43] [Keep Alive Stat] LS Keep Alive Info(tenant_id=1002, LS_ID={id:1}, Not_Master_Cnt=0, Near_To_GTS_Cnt=5, Other_Error_Cnt=0, Submit_Succ_Cnt=95, last_scn="{val:1745215793764987000, v:0}", last_lsn={lsn:17432845}, last_gts={val:1745215795266728000, v:0}, min_start_scn="{val:0, v:0}", min_start_status=1, sys_ls_end_scn={val:0, v:0}) [2025-04-21 14:09:55.584495] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [620309][T1002_LSArchive][T1002][YB420B1D7AB6-00063343AF0EFD86-0-0] [lt=36] gc stale ls task succ [2025-04-21 14:09:55.596415] INFO [PALF] is_allowed_broadcast_ (palf_handle_impl.h:1402) [620080][T1001_Occam][T1001][Y0-0000000000000000-0-0] [lt=99] keep in silent because of disconnected with RS, do not solicit votes.(is_in_silent=false, palf_id=1, is_allowed_broadcast=true) [2025-04-21 14:09:55.604571] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=21] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:55.604625] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=45] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.606755] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [620319][T1002_HAService][T1002][Y0-0000000000000000-0-0] [lt=41] start do ls ha handler(ls_id_array_=[{id:1}, {id:1001}]) [2025-04-21 14:09:55.606803] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=41][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.609203] WDIAG [SHARE] get (ob_global_stat_proxy.cpp:529) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=22][errcode=-4152] get int failed(name="finish_data_version", ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:55.609248] WDIAG [SHARE] get_finish_data_version (ob_global_stat_proxy.cpp:296) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4152] get failed(ret=-4152, ret="OB_ERR_NULL_VALUE") [2025-04-21 14:09:55.610903] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=32][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:55.610941] WDIAG [SQL] build_service_name_ (ob_service_name_proxy.cpp:586) [620228][T1002_TenantInf][T1002][Y0-0000000000000000-0-0] [lt=36][errcode=-4152] fail to get column in row. (column_name="service_name_id", ret=-4152) [2025-04-21 14:09:55.649978] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c357ab470, extra_info="") [2025-04-21 14:09:55.650034] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=42] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c248bd410, extra_info="id:1001") [2025-04-21 14:09:55.651444] INFO [PALF] read (log_cache.cpp:103) [620221][T1002_LogShared][T1002][Y0-0000000000000000-0-0] [lt=57] [PALF STAT HOT CACHE HIT RATE](palf_id=1, read_size=1220, hit_cnt=10, read_cnt=10, hit rate=1.000000000000000000e+00) [2025-04-21 14:09:55.695155] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619645][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=41] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695192] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619646][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=46] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695267] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619641][BatchIO][T0][Y0-0000000000000000-0-0] [lt=38] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695402] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619649][MysqlUnix][T0][Y0-0000000000000000-0-0] [lt=35] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695421] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619640][BatchIO][T0][Y0-0000000000000000-0-0] [lt=31] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695667] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619647][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=38] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695725] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619638][BatchIO][T0][Y0-0000000000000000-0-0] [lt=27] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.695739] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619639][BatchIO][T0][Y0-0000000000000000-0-0] [lt=29] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.696000] INFO [RPC.FRAME] mysql_easy_timer_cb (ob_net_easy.cpp:676) [619644][MysqlIO][T0][Y0-0000000000000000-0-0] [lt=34] [MYSQL EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.696453] INFO [RPC.FRAME] batch_rpc_easy_timer_cb (ob_net_easy.cpp:641) [619642][BatchIO][T0][Y0-0000000000000000-0-0] [lt=33] [BATCH_RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.696895] INFO [RPC.FRAME] rpc_easy_timer_cb (ob_net_easy.cpp:603) [619651][RpcUnix][T0][Y0-0000000000000000-0-0] [lt=31] [RPC EASY STAT](log_str=conn count=0/0, request done=0/0, request doing=0/0) [2025-04-21 14:09:55.706887] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=38][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.710755] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=25] replay status is not follower(min_unreplayed_lsn={lsn:16036966}, base_lsn={lsn:0}, this={ls_id_:{id:1}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620369965, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:2721933, ret_code_:0}}, next_to_submit_lsn_:{lsn:16036966}, next_to_submit_scn_:{val:1745215176618433003, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214062199618000, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c24205000, next_round_pread_size:3678208, curr_read_pos:742, curr_read_buf_start_pos:0, curr_read_buf_end_pos:742, log_storage_:{start_lsn:{lsn:16036224}, end_lsn:{lsn:16036966}, read_buf:{buf_len_:3747840, buf_:0x7f3c24205000}, block_size:67104768, log_storage_:0x7f3c3573da30, log_storage_:{log_tail:{lsn:17435104}, readable_log_tail:{lsn:17435104}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49669664, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176618433002, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:654, scn_:{val:1745215176618433002, v:0}, data_checksum:282748325, flag:19514}}, init_mode_version:0, accumulate_checksum:3684865356, curr_entry_is_padding:0, padding_entry_size:686, padding_entry_scn:{val:1745215176618433002, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:6, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:8, read_io_size:16252928, read_disk_cost_ts:163774, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:55.710889] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=133] get_replay_process success(id={id:1}, submitted_log_size=16036966, unsubmitted_log_size=0, replayed_log_size=16036966, unreplayed_log_size=0) [2025-04-21 14:09:55.710913] INFO [CLOG] get_replay_process (ob_replay_status.cpp:1092) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=19] replay status is not follower(min_unreplayed_lsn={lsn:8363958}, base_lsn={lsn:0}, this={ls_id_:{id:1001}, is_enabled_:true, is_submit_blocked_:false, role_:1, err_info_:{lsn_:{lsn:18446744073709551615}, scn_:{val:0, v:0}, log_type_:0, is_submit_err_:false, err_ts_:0, err_ret_:0}, ref_cnt_:1, post_barrier_lsn_:{lsn:18446744073709551615}, pending_task_count_:0, submit_log_task_:{ObReplayServiceSubmitTask:{type_:1, enqueue_ts_:1745215620873683, err_info_:{has_fatal_error_:false, fail_ts_:0, fail_cost_:1721386, ret_code_:0}}, next_to_submit_lsn_:{lsn:8363958}, next_to_submit_scn_:{val:1745215176667416001, v:0}, base_lsn_:{lsn:0}, base_scn_:{val:1745214089842480001, v:0}, iterator_:{iterator_impl:{buf_:0x7f3c0c605000, next_round_pread_size:3678208, curr_read_pos:122, curr_read_buf_start_pos:0, curr_read_buf_end_pos:122, log_storage_:{start_lsn:{lsn:8363836}, end_lsn:{lsn:8363958}, read_buf:{buf_len_:3747840, buf_:0x7f3c0c605000}, block_size:67104768, log_storage_:0x7f3c357b1a30, log_storage_:{log_tail:{lsn:9208335}, readable_log_tail:{lsn:9208335}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57896433, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, storage_type:"DISK_STORAGE"}, curr_entry_is_raw_write:false, curr_entry_size:0, prev_entry_scn:{val:1745215176667416000, v:0}, curr_entry:{LogEntryHeader:{magic:19528, version:2, log_size:34, scn_:{val:1745215176667416000, v:0}, data_checksum:154833137, flag:41901}}, init_mode_version:0, accumulate_checksum:4200394015, curr_entry_is_padding:0, padding_entry_size:66, padding_entry_scn:{val:1745215176667416000, v:0}}, io_ctx:{user:"REPLAY", palf_id_:-1, iterator_info_:{allow_filling_cache:true, hot_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, cold_cache_stat:{hit_cnt:0, miss_cnt:4, cache_read_size:0, hit_ratio:"0.000000000000000000e+00"}, read_io_cnt:5, read_io_size:8429568, read_disk_cost_ts:58810, start_lsn:{lsn:0}}}}}}) [2025-04-21 14:09:55.710977] INFO [CLOG] operator() (ob_log_replay_service.cpp:1679) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=63] get_replay_process success(id={id:1001}, submitted_log_size=8363958, unsubmitted_log_size=0, replayed_log_size=8363958, unreplayed_log_size=0) [2025-04-21 14:09:55.711018] INFO [CLOG] runTimerTask (ob_log_replay_service.cpp:182) [620271][T1002_ReplayPro][T1002][Y0-0000000000000000-0-0] [lt=18] dump tenant replay process(tenant_id=1002, unsubmitted_log_size(MB)=0, unreplayed_log_size(MB)=0, estimate_time(second)=0, submitted_log_size(MB)=23, replayed_log_size(MB)=23, last_submitted_log_size(MB)=23, last_replayed_log_size(MB)=23, round_cost_time(second)=10, pending_replay_log_size(MB)=0) [2025-04-21 14:09:55.720851] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=67] get number(ret=0, service_type_=0, range=1, base_id=1745215795720640000, start_id=1745215795720640000, end_id=1745215795720640001) [2025-04-21 14:09:55.727484] INFO [SHARE] get_freeze_info_larger_or_equal_than (ob_freeze_info_proxy.cpp:168) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=32] finish load_freeze_info(ret=0, ret="OB_SUCCESS", tenant_id=1, sql=SELECT * FROM __all_freeze_info WHERE frozen_scn >= 1 ORDER BY frozen_scn) [2025-04-21 14:09:55.728745] INFO [SHARE] get_all_snapshots (ob_snapshot_table_proxy.cpp:428) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=56] get all snapshots(ret=0, snapshots.count()=0, snapshots=[]) [2025-04-21 14:09:55.728849] INFO [SHARE] update_freeze_info (ob_freeze_info_manager.cpp:219) [619826][T1_FreInfoReloa][T1][Y0-0000000000000000-0-0] [lt=42] inner load succ(latest_freeze_info={frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}, freeze_info_={latest_snapshot_gc_scn:{val:1745215795629322000, v:0}, frozen_statuses_.count():1, frozen_statuses:[{frozen_version:{val:1, v:0}, schema_version:1, data_version:17180066817}]}) [2025-04-21 14:09:55.741393] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=53] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=8) [2025-04-21 14:09:55.751681] INFO [LIB] stat (utility.h:1176) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=55] [PALF STAT WRITE LOG COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1386, this=0x7f3c357b5bb0, extra_info="") [2025-04-21 14:09:55.751763] INFO [LIB] stat (utility.h:1193) [620217][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=69] [PALF STAT IO TASK IN QUEUE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=31, this=0x7f3c359b0c70, extra_info="") [2025-04-21 14:09:55.751787] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT FS CB EXCUTE COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=10, this=0x7f3c357ab6a0, extra_info="palf_id:1001") [2025-04-21 14:09:55.751828] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT LOG LIFE TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1526, this=0x7f3c357ab8d0, extra_info="palf_id:1001") [2025-04-21 14:09:55.751852] INFO [LIB] stat (utility.h:1176) [620215][T1002_LogIOCb0][T1002][Y0-0000000000000000-0-0] [lt=20] [PALF STAT FLUSH CB COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=51, this=0x7f3c357b5de0, extra_info="") [2025-04-21 14:09:55.761798] INFO [SERVER] check_tenant_memory (ob_plugin_vector_index_scheduler.cpp:488) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDAB-0-0] [lt=18] get vector mem limit size(ret=0, ret="OB_SUCCESS", tenant_id=1002, current_memory_config=0) [2025-04-21 14:09:55.761857] INFO [SERVER] execute_adapter_maintenance (ob_plugin_vector_index_scheduler.cpp:472) [620282][T1002_TTLTablet][T1002][YB420B1D7AB6-00063343B23EFDAB-0-0] [lt=48] finish generate tenant tablet tasks(ret=0, ret="OB_SUCCESS", tenant_id=1002) [2025-04-21 14:09:55.763012] INFO [CLOG.EXTLOG] run1 (ob_cdc_service.cpp:184) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=37] query dest_info_ succ(dest_info=[], archive_dest_changed=false) [2025-04-21 14:09:55.763057] INFO [CLOG.EXTLOG] resize_log_ext_handler_ (ob_cdc_service.cpp:647) [620273][T1002_CdcSrv][T1002][Y0-0000000000000000-0-0] [lt=41] finish to resize log external storage handler(current_ts=1745215795763053, tenant_max_cpu=1, valid_ls_v1_count=0, valid_ls_v2_count=0, other_ls_count=0, new_concurrency=0) [2025-04-21 14:09:55.763627] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=53] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:55.767493] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=29] get number(ret=0, service_type_=0, range=1, base_id=1745215795766612000, start_id=1745215795766612000, end_id=1745215795766612001) [2025-04-21 14:09:55.767538] INFO [STORAGE.TRANS] handle_request (ob_timestamp_service.cpp:175) [619632][TsMgr][T1][Y0-0000000000000000-0-0] [lt=42] handle gts request statistics(total_rt=402, total_cnt=60, avg_rt=6.590163934426229275e+00, avg_cnt=6.000000000000000000e+00) [2025-04-21 14:09:55.767764] INFO [STORAGE.TRANS] refresh_gts (ob_gts_source.cpp:520) [619632][TsMgr][T0][Y0-0000000000000000-0-0] [lt=25] refresh gts(ret=0, ret="OB_SUCCESS", tenant_id=1002, need_refresh=false, gts_local_cache={srr:[mts=1745215795767747], gts:1745215795767675000, latest_srr:[mts=1745215795767747]}) [2025-04-21 14:09:55.768874] INFO [CLOG] run1 (ob_garbage_collector.cpp:1466) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] Garbage Collector is running(seq_=19, gc_interval=10000000) [2025-04-21 14:09:55.768951] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=41] self is leader, skip it(ls->get_ls_id()={id:1}) [2025-04-21 14:09:55.768981] INFO [CLOG] construct_server_ls_map_for_member_list_ (ob_garbage_collector.cpp:1601) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=26] self is leader, skip it(ls->get_ls_id()={id:1001}) [2025-04-21 14:09:55.769031] INFO [CLOG] gc_check_member_list_ (ob_garbage_collector.cpp:1559) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=18] gc_check_member_list_ cost time(ret=0, time_us=114) [2025-04-21 14:09:55.769070] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=2) [2025-04-21 14:09:55.770448] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=21] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:55.771747] INFO [CLOG] gc_check_ls_status_ (ob_garbage_collector.cpp:1755) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=36] gc_candidates push_back success(ret=0, candidate={ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}) [2025-04-21 14:09:55.771791] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=37] ls status is normal, skip(id={id:1}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:55.771817] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1777) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=23] ls status is normal, skip(id={id:1001}, gc_candidates=[{ls_id_:{id:1}, ls_status_:1, gc_reason_:0}, {ls_id_:{id:1001}, ls_status_:1, gc_reason_:0}]) [2025-04-21 14:09:55.771841] INFO [CLOG] execute_gc_ (ob_garbage_collector.cpp:1833) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=21] execute_gc cost time(ret=0, time_us=52) [2025-04-21 14:09:55.771862] INFO [SERVER] handle (ob_safe_destroy_handler.cpp:240) [620277][T1002_GCCollect][T1002][Y0-0000000000000000-0-0] [lt=17] ObSafeDestroyHandler start process [2025-04-21 14:09:55.773263] INFO [SHARE] get_zone_list_ (ob_zone_table_operation.cpp:559) [619834][T1_HBService][T1][YB420B1D7AB6-00063343B0DEFDE3-0-0] [lt=39] get inactive zone_list(ret=0, ret="OB_SUCCESS", zone_list=[]) [2025-04-21 14:09:55.779080] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620303][T1002_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=32] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=7885) [2025-04-21 14:09:55.797941] INFO do_work (ob_rl_mgr.cpp:705) [619544][rl_mgr0][T0][Y0-0000000000000000-0-0] [lt=55] swc wakeup.(stat_period_=1000000, ready=false) [2025-04-21 14:09:55.801484] INFO [COORDINATOR] refresh (ob_leader_coordinator.cpp:146) [620209][T1002_Occam][T1002][Y0-0000000000000000-0-0] [lt=55] refresh __all_ls_election_reference_info success(ret=0, ret="OB_SUCCESS", *new_all_ls_election_reference_info=[{1,0,False,{False,},False,False,True}, {1001,0,False,{False,},False,False,True}]) [2025-04-21 14:09:55.806955] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=43][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.814912] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04CD-0-0] [lt=34][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.815908] WDIAG begin (ob_hashtable.h:954) [620347][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B89EFDDB-0-0] [lt=47][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.815909] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE51-0-0] [lt=46][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.816229] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE52-0-0] [lt=31][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.819466] INFO [STORAGE] runTimerTask (ob_checkpoint_service.cpp:298) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=28] ====== check clog disk timer task ====== [2025-04-21 14:09:55.819508] INFO [PALF] get_disk_usage (palf_env_impl.cpp:908) [619981][T1_CKClogDisk][T1][Y0-0000000000000000-0-0] [lt=35] get_disk_usage(ret=0, capacity(MB):=5120, used(MB):=126) [2025-04-21 14:09:55.819529] WDIAG begin (ob_hashtable.h:954) [620346][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B86EFE54-0-0] [lt=38][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.819552] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04D0-0-0] [lt=41][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.829808] INFO [ARCHIVE] gc_stale_ls_task_ (ob_ls_mgr.cpp:584) [619984][T1_LSArchiveMgr][T1][YB420B1D7AB6-00063343AC4EFD86-0-0] [lt=40] gc stale ls task succ [2025-04-21 14:09:55.842807] INFO [STORAGE] scheduler_ls_ha_handler_ (ob_storage_ha_service.cpp:195) [619994][T1_HAService][T1][Y0-0000000000000000-0-0] [lt=37] start do ls ha handler(ls_id_array_=[{id:1}]) [2025-04-21 14:09:55.850108] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=22] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c35737470, extra_info="") [2025-04-21 14:09:55.850169] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=45] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:55.850198] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND DATA SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:55.850226] INFO [LIB] stat (utility.h:1176) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=25] [PALF STAT APPEND COST TIME](cur_stat_count=10, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c2486b410, extra_info="id:1") [2025-04-21 14:09:55.851663] INFO [PALF] inner_append_log (palf_handle_impl.cpp:2229) [620216][T1002_IOWorker][T1002][Y0-0000000000000000-0-0] [lt=17] [PALF STAT INNER APPEND LOG SIZE](this={palf_id:1, self:"11.29.122.182:2882", has_set_deleted:false}, accum_size=1220) [2025-04-21 14:09:55.897259] INFO [STORAGE] operator() (ob_tenant_freezer.cpp:129) [619813][T1_Occam][T1][Y0-0000000000000000-0-0] [lt=64] ====== tenant freeze timer task ====== [2025-04-21 14:09:55.899593] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=19] sql audit evict task end(request_manager_->get_tenant_id()=1, evict_high_mem_level=128849018, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=79030272) [2025-04-21 14:09:55.899663] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [619977][T1_ReqMemEvict][T1][Y0-0000000000000000-0-0] [lt=60] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.903774] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=43] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:10819, max_lsn:17435348, max_scn:{val:1745215795767675000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:16036224}, reuse_lsn:{lsn:17435348}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:16036966}}, last_submit_lsn:{lsn:17435226}, last_submit_end_lsn:{lsn:17435348}, last_submit_log_id:10819, last_submit_log_pid:3, max_flushed_lsn:{lsn:17435226}, max_flushed_end_lsn:{lsn:17435348}, max_flushed_log_pid:3, committed_end_lsn:{lsn:17435348}, last_slide_log_id:10819, last_slide_scn:{val:1745215795767675000, v:0}, last_slide_lsn:{lsn:17435226}, last_slide_end_lsn:{lsn:17435348}, last_slide_log_pid:3, last_slide_log_accum_checksum:477121580, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c35736530}, [StateMgr]={this:0x7f3c3573a830, self:"11.29.122.182:2882", palf_id:1, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:10820, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620169570, palf_role_change_cb:0x7f3c35741270, allow_vote:true}, [ConfigMgr]={palf_id:1, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_end_lsn:{lsn:16036966}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c35737c70}, [ModeMgr]={palf_id:1, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:2, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:16036224}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/meta", dir_fd:149, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c3573c9f8, flashback_version:0}, log_storage:{log_tail:{lsn:17435348}, readable_log_tail:{lsn:17435348}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1/log", dir_fd:151, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:49669420, block_header_serialize_buf_:0x7f3c3573e6b8, flashback_version:0}, palf_epoch:1, last_purge_throttling_ts:1745215620169802, this:0x7f3c3573af70}, [Reconfirm]={palf_id:1, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:16036966}, saved_end_lsn:{lsn:16036966}, last_submit_prepare_req_time_us:1745215620170137, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c3573a9b0}) [2025-04-21 14:09:55.904033] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=251] [PALF_DUMP](palf_id=1, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215795851730, last_flushed_end_lsn:{lsn:17435348}}]) [2025-04-21 14:09:55.904060] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=23] current log_task status(palf_id=1, self="11.29.122.182:2882", log_id=10820, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215795851730, last_flushed_end_lsn:{lsn:17435348}}]) [2025-04-21 14:09:55.904107] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2745) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=37] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", [SlidingWindow]={palf_id:1001, self:"11.29.122.182:2882", lsn_allocator:{max_log_id:14971, max_lsn:9208579, max_scn:{val:1745215795767675000, v:0}}, group_buffer:{log_group_buffer: start_lsn:{lsn:8363836}, reuse_lsn:{lsn:9208579}, reserved_buffer_size:41943040, available_buffer_size:33554432, readable_begin_lsn:{lsn:8363958}}, last_submit_lsn:{lsn:9208457}, last_submit_end_lsn:{lsn:9208579}, last_submit_log_id:14971, last_submit_log_pid:3, max_flushed_lsn:{lsn:9208457}, max_flushed_end_lsn:{lsn:9208579}, max_flushed_log_pid:3, committed_end_lsn:{lsn:9208579}, last_slide_log_id:14971, last_slide_scn:{val:1745215795767675000, v:0}, last_slide_lsn:{lsn:9208457}, last_slide_end_lsn:{lsn:9208579}, last_slide_log_pid:3, last_slide_log_accum_checksum:3502355251, last_fetch_end_lsn:{lsn:18446744073709551615}, last_fetch_max_log_id:-1, last_fetch_committed_end_lsn:{lsn:18446744073709551615}, last_truncate_lsn:{lsn:18446744073709551615}, last_fetch_req_time:0, is_truncating:false, is_rebuilding:false, last_rebuild_lsn:{lsn:18446744073709551615}, freeze_mode:"FEEDBACK_FREEZE_MODE", has_pending_handle_submit_task:false, last_fetch_trigger_type:"LOG_LOOP_TH", this:0x7f3c357aa530}, [StateMgr]={this:0x7f3c357ae830, self:"11.29.122.182:2882", palf_id:1001, role:"LEADER", replica_type:"NORMAL_REPLICA", state:"ACTIVE", prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, leader:"11.29.122.182:2882", leader_epoch:1, is_sync_enabled:true, allow_vote:true, allow_vote_persisted:true, pending_end_lsn:{lsn:18446744073709551615}, scan_disk_log_finished:true, last_check_start_id:14972, is_changing_config_with_arb:false, reconfirm_start_time_us:1745215620673291, palf_role_change_cb:0x7f3c357b5270, allow_vote:true}, [ConfigMgr]={palf_id:1001, self:"11.29.122.182:2882", alive_paxos_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, alive_paxos_replica_num:1, log_ms_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, running_args:{server:{server:"0.0.0.0:0", timestamp:-1, flag:0}, curr_member_list:0, curr_replica_num:0, new_replica_num:1, config_version:{proposal_id:9223372036854775807, config_seq:-1}, ref_scn:{val:18446744073709551615, v:3}, lock_owner:-1, lock_type:0, added_list:0, removed_list:0, type:"STARTWORKING"}, state:0, checking_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, reconfig_barrier:{prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_end_lsn:{lsn:8363958}, prev_mode_pid:3}, persistent_config_version:{proposal_id:3, config_seq:4}, ms_ack_list:0, resend_config_version:{proposal_id:3, config_seq:4}, resend_log_list:{learner_num:0, learner_array:[]}, last_submit_config_log_time_us:-1, need_change_config_bkgd:false, bkgd_config_version:{proposal_id:9223372036854775807, config_seq:-1}, region:"sys_region", register_time_us:-1, parent:"0.0.0.0:0", parent_keepalive_time_us:-1, last_submit_register_req_time_us:-1, children:{learner_num:0, learner_array:[]}, last_submit_keepalive_time_us:-1, this:0x7f3c357abc70}, [ModeMgr]={palf_id:1001, self:"11.29.122.182:2882", applied_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, accepted_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, last_submit_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}, state:"MODE_INIT", new_proposal_id:9223372036854775807, local_max_lsn:{lsn:18446744073709551615}, local_max_log_pid:9223372036854775807, max_majority_accepted_pid:9223372036854775807, max_majority_lsn:{lsn:18446744073709551615}, max_majority_accepted_mode_meta:{version:-1, proposal_id:9223372036854775807, mode_version:9223372036854775807, access_mode:0, ref_scn:{val:18446744073709551615, v:3}}, follower_list:0, ack_list:0, majority_cnt:9223372036854775807, last_submit_req_ts:-1, resend_mode_meta_list:{learner_num:0, learner_array:[]}}, [LogEngine]={palf_id:1001, is_inited:true, min_block_max_scn:{val:18446744073709551615, v:3}, min_block_id:0, min_block_min_scn:{val:1745214072182794001, v:0}, base_lsn_for_block_gc:{lsn:0}, log_meta:{version:1, log_prepare_meta:{version:1, voted_for:"0.0.0.0:0", log_proposal_id:3}, log_config_meta:{version:3, proposal_id:3, prev:{version:1, config:{config_version:{proposal_id:2, config_seq:3}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, curr:{version:1, config:{config_version:{proposal_id:3, config_seq:4}, log_sync_memberlist:1{server:"11.29.122.182:2882", timestamp:1, flag:0}, log_sync_replica_num:1, arbitration_member:{server:"0.0.0.0:0", timestamp:-1, flag:0}, learnerlist:{learner_num:0, learner_array:[]}, degraded_learnerlist:{learner_num:0, learner_array:[]}}, lock_meta:{version:1, lock_type:0, lock_owner:-1, lock_time:-1}}, prev_log_proposal_id:2, prev_lsn:{lsn:8363836}, prev_mode_pid:3}, log_snapshot_meta:{version:2, base_lsn:{lsn:0}, prev_log_info:{log_id:0, lsn:{lsn:0}, scn:{val:1745214072182794000, v:0}, log_proposal_id:9223372036854775807, accum_checksum:-1}, prev_log_tail_lsn:{lsn:0}}, log_replica_property_meta:{allow_vote:true, replica_type:"NORMAL_REPLICA"}, log_mode_meta:{version:1, proposal_id:3, mode_version:0, access_mode:1, ref_scn:{val:1745214072182794000, v:0}}}, log_meta_storage:{log_tail:{lsn:45056}, readable_log_tail:{lsn:45056}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:67104768}, min_scn:{val:0, v:0}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/meta", dir_fd:146, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:67059712, block_header_serialize_buf_:0x7f3c357b09f8, flashback_version:0}, log_storage:{log_tail:{lsn:9208579}, readable_log_tail:{lsn:9208579}, log_block_header:{magic:18754, version:1, min_lsn:{lsn:18446744073709551615}, min_scn:{val:18446744073709551615, v:3}, curr_block_id:0, palf_id:1001}, block_mgr:{log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002/1001/log", dir_fd:154, min_block_id:0, max_block_id:1, curr_writable_block_id:0}, logical_block_size_:67104768, curr_block_writable_size_:57896189, block_header_serialize_buf_:0x7f3c357b26b8, flashback_version:0}, palf_epoch:2, last_purge_throttling_ts:1745215620673557, this:0x7f3c357aef70}, [Reconfirm]={palf_id:1001, self:"11.29.122.182:2882", state:"FINISHED", new_proposal_id:3, prepare_log_ack_list:0, curr_paxos_follower_list:0, majority_cnt:1, majority_max_log_server:"11.29.122.182:2882", majority_max_accept_pid:2, majority_max_lsn:{lsn:8363958}, saved_end_lsn:{lsn:8363958}, last_submit_prepare_req_time_us:1745215620673904, last_fetch_log_time_us:-1, last_record_sw_start_id:-1, last_notify_fetch_time_us:-1, last_purge_throttling_time_us:-1, this:0x7f3c357ae9b0}) [2025-04-21 14:09:55.904286] INFO [PALF] check_and_switch_state (palf_handle_impl.cpp:2749) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=176] [PALF_DUMP](palf_id=1001, self="11.29.122.182:2882", ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215795851598, last_flushed_end_lsn:{lsn:9208579}}]) [2025-04-21 14:09:55.904304] INFO [PALF] report_log_task_trace (log_sliding_window.cpp:4325) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=16] current log_task status(palf_id=1001, self="11.29.122.182:2882", log_id=14972, log_task={header:{begin_lsn:{lsn:18446744073709551615}, end_lsn:{lsn:18446744073709551615}, log_id:-1, min_scn:{val:18446744073709551615, v:3}, max_scn:{val:18446744073709551615, v:3}, data_len:0, proposal_id:9223372036854775807, prev_lsn:{lsn:18446744073709551615}, prev_proposal_id:9223372036854775807, committed_end_lsn:{lsn:18446744073709551615}, data_checksum:-1, accum_checksum:-1, is_padding_log:false, is_raw_write:false}, state_map:{val:0}, ref_cnt:0, gen_ts:-1, freeze_ts:-1, submit_ts:-1, flushed_ts:-1, gen_to_freeze cost time:0, gen_to_submit cost time:0, submit_to_flush cost time:0}, ack_info_list=[{member:{server:"11.29.122.182:2882", timestamp:1, flag:0}, last_ack_time_us:1745215795851598, last_flushed_end_lsn:{lsn:9208579}}]) [2025-04-21 14:09:55.907029] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=39][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:55.920781] INFO [LIB] stat (utility.h:1176) [620163][T1001_TenantWea][T1001][Y0-0000000000000000-0-0] [lt=44] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c4a4cb470, extra_info="") [2025-04-21 14:09:55.941546] INFO [COMMON] replace_map (ob_kv_storecache.cpp:766) [619506][KVCacheRep][T0][Y0-0000000000000000-0-0] [lt=45] replace map num details(ret=0, replace_node_count=0, map_once_replace_num_=100000, map_replace_skip_count_=7) [2025-04-21 14:09:55.950199] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=19] [PALF STAT GROUP LOG INFO](palf_id=1001, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=10, avg_log_batch_cnt=1, total_group_log_size=1220, avg_group_log_size=122) [2025-04-21 14:09:55.950243] INFO [PALF] submit_log (palf_handle_impl.cpp:456) [620320][T1002_TxLoopWor][T1002][Y0-0000000000000000-0-0] [lt=40] [PALF STAT APPEND DATA SIZE](this={palf_id:1001, self:"11.29.122.182:2882", has_set_deleted:false}, append size=1220) [2025-04-21 14:09:55.964096] INFO [COMMON] compute_tenant_wash_size (ob_kvcache_store.cpp:1136) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=40] Wash compute wash size(is_wash_valid=false, sys_total_wash_size=-43575853056, global_cache_size=260096000, tenant_max_wash_size=0, tenant_min_wash_size=0, tenant_ids_=[cnt:6, 500, 508, 509, 1, 1001, 1002]) [2025-04-21 14:09:55.965094] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=20] [PALF STAT PUSH LOG TO FOLLOWERS RPC POST COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=1, this=0x7f3c6c7bb470, extra_info="") [2025-04-21 14:09:55.965145] INFO [PALF] handle_next_submit_log_ (log_sliding_window.cpp:1093) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=38] [PALF STAT GROUP LOG INFO](palf_id=1, self="11.29.122.182:2882", role="LEADER", total_group_log_cnt=13, avg_log_batch_cnt=1, total_group_log_size=5396, avg_group_log_size=415) [2025-04-21 14:09:55.965189] INFO [LIB] stat (utility.h:1176) [619995][T1_TxLoopWorker][T1][Y0-0000000000000000-0-0] [lt=37] [PALF STAT APPEND COST TIME](cur_stat_count=13, stat_interval=1000000, avg (count/cost)=0, this=0x7f3c55747410, extra_info="id:1") [2025-04-21 14:09:55.966515] INFO [SHARE] run_loop_ (ob_bg_thread_monitor.cpp:331) [620399][BGThreadMonitor][T0][Y0-0000000000000000-0-0] [lt=47] current monitor number(seq_=-1) [2025-04-21 14:09:55.973376] INFO [COMMON] clean_garbage_node (ob_kvcache_map.cpp:671) [619505][KVCacheWash][T0][Y0-0000000000000000-0-0] [lt=50] Cache wash clean map node details(ret=0, clean_node_count=0, clean_time=0, clean_start_pos=6800000, clean_num=200000) [2025-04-21 14:09:55.981197] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1001, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=10398720) [2025-04-21 14:09:55.981249] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620162][T1001_ReqMemEvi][T1001][Y0-0000000000000000-0-0] [lt=42] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:55.996531] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04D1-0-0] [lt=44][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:55.997578] INFO [DETECT] record_summary_info_and_logout_when_necessary_ (ob_lcl_batch_sender_thread.cpp:202) [620156][T1001_LCLSender][T1001][Y0-0000000000000000-0-0] [lt=60] ObLCLBatchSenderThread periodic report summary info(duty_ratio_percentage=0, total_constructed_detector=0, total_destructed_detector=0, total_alived_detector=0, _lcl_op_interval=30000, lcl_msg_map_.count()=0, *this={this:0x7f3c4d9fe2b0, is_inited:true, is_running:true, total_record_time:5010000, over_night_times:0}) [2025-04-21 14:09:55.998106] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04D3-0-0] [lt=43][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:56.002463] INFO [STORAGE.TRANS] get_number (ob_id_service.cpp:393) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=34] get number(ret=0, service_type_=0, range=1, base_id=1745215796001464000, start_id=1745215796001464000, end_id=1745215796001464001) [2025-04-21 14:09:56.003851] INFO [PALF] log_loop_ (log_loop_thread.cpp:155) [620224][T1002_LogLoop][T1002][Y0-0000000000000000-0-0] [lt=31] LogLoopThread round_cost_time(us)(round_cost_time=585) [2025-04-21 14:09:56.004109] INFO [SERVER] scheduler (ob_dbms_sched_job_master.cpp:221) [620001][T1_DBMSSched][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=45] success to scheduler single dbms sched job(ret=0, tmp_ret=0) [2025-04-21 14:09:56.004276] INFO [SERVER] process (ob_dbms_sched_job_rpc_processor.cpp:55) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=37] dbms sched job run rpc process start(ret=0) [2025-04-21 14:09:56.005857] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=54] load default system variable(auto_increment_increment="1") [2025-04-21 14:09:56.005896] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=35] load default system variable(auto_increment_offset="1") [2025-04-21 14:09:56.005912] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(autocommit="1") [2025-04-21 14:09:56.005925] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=11] load default system variable(character_set_client="45") [2025-04-21 14:09:56.005943] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(character_set_connection="45") [2025-04-21 14:09:56.005959] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(character_set_database="45") [2025-04-21 14:09:56.005977] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(character_set_results="45") [2025-04-21 14:09:56.005994] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(character_set_server="45") [2025-04-21 14:09:56.006011] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(character_set_system="45") [2025-04-21 14:09:56.006028] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(collation_connection="45") [2025-04-21 14:09:56.006039] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=10] load default system variable(collation_database="45") [2025-04-21 14:09:56.006056] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(collation_server="45") [2025-04-21 14:09:56.006072] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(interactive_timeout="28800") [2025-04-21 14:09:56.006090] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(last_insert_id="0") [2025-04-21 14:09:56.006107] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_allowed_packet="16777216") [2025-04-21 14:09:56.006124] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_mode="281018368") [2025-04-21 14:09:56.006145] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(time_zone="+08:00") [2025-04-21 14:09:56.006162] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(tx_isolation="READ-COMMITTED") [2025-04-21 14:09:56.006180] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(version_comment="OceanBase_CE 4.3.4.1 (r101000032024121814-50c70ec9b4360352607cbed6587000307b82694e) (Built Dec 18 2024 16:09:45)") [2025-04-21 14:09:56.006197] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(wait_timeout="28800") [2025-04-21 14:09:56.006214] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_row_image="2") [2025-04-21 14:09:56.006230] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(character_set_filesystem="63") [2025-04-21 14:09:56.006247] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(connect_timeout="10") [2025-04-21 14:09:56.006264] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(datadir="/home/oceanbase/tianxing/oceanbase/store") [2025-04-21 14:09:56.006281] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(debug_sync="") [2025-04-21 14:09:56.006298] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(div_precision_increment="4") [2025-04-21 14:09:56.006314] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(explicit_defaults_for_timestamp="1") [2025-04-21 14:09:56.006331] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_concat_max_len="1024") [2025-04-21 14:09:56.006348] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(identity="0") [2025-04-21 14:09:56.006364] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(lower_case_table_names="2") [2025-04-21 14:09:56.006382] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(net_read_timeout="30") [2025-04-21 14:09:56.006398] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(net_write_timeout="60") [2025-04-21 14:09:56.006414] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(read_only="0") [2025-04-21 14:09:56.006430] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_auto_is_null="0") [2025-04-21 14:09:56.006446] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_select_limit="9223372036854775807") [2025-04-21 14:09:56.006464] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(timestamp="0") [2025-04-21 14:09:56.006479] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(tx_read_only="0") [2025-04-21 14:09:56.006495] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(version="") [2025-04-21 14:09:56.006511] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_warnings="0") [2025-04-21 14:09:56.006523] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=10] load default system variable(max_user_connections="0") [2025-04-21 14:09:56.006539] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(init_connect="") [2025-04-21 14:09:56.006555] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(license="") [2025-04-21 14:09:56.006572] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(net_buffer_length="16384") [2025-04-21 14:09:56.006588] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(system_time_zone="+08:00") [2025-04-21 14:09:56.006604] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_cache_size="0") [2025-04-21 14:09:56.006621] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_cache_type="0") [2025-04-21 14:09:56.006637] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_quote_show_create="1") [2025-04-21 14:09:56.006653] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_sp_recursion_depth="0") [2025-04-21 14:09:56.006669] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(sql_safe_updates="0") [2025-04-21 14:09:56.006698] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26] load default system variable(concurrent_insert="AUTO") [2025-04-21 14:09:56.006716] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(default_authentication_plugin="mysql_native_password") [2025-04-21 14:09:56.006732] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(disabled_storage_engines="") [2025-04-21 14:09:56.006749] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(error_count="0") [2025-04-21 14:09:56.006765] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(general_log="0") [2025-04-21 14:09:56.006781] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(have_openssl="YES") [2025-04-21 14:09:56.006797] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(have_profiling="NO") [2025-04-21 14:09:56.006813] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(have_ssl="YES") [2025-04-21 14:09:56.006829] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(hostname="") [2025-04-21 14:09:56.006845] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(lc_messages="en_US") [2025-04-21 14:09:56.006861] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(local_infile="1") [2025-04-21 14:09:56.006877] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(lock_wait_timeout="31536000") [2025-04-21 14:09:56.006907] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26] load default system variable(long_query_time="10") [2025-04-21 14:09:56.006925] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(max_connections="2147483647") [2025-04-21 14:09:56.006942] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_execution_time="0") [2025-04-21 14:09:56.006958] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(protocol_version="10") [2025-04-21 14:09:56.006974] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(server_id="1") [2025-04-21 14:09:56.006990] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_ca="") [2025-04-21 14:09:56.007006] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_capath="") [2025-04-21 14:09:56.007021] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(ssl_cert="") [2025-04-21 14:09:56.007037] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_cipher="") [2025-04-21 14:09:56.007053] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_crl="") [2025-04-21 14:09:56.007069] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_crlpath="") [2025-04-21 14:09:56.007085] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ssl_key="") [2025-04-21 14:09:56.007101] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(time_format="%H:%i:%s") [2025-04-21 14:09:56.007117] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(tls_version="") [2025-04-21 14:09:56.007108] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=42][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:56.007133] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(tmp_table_size="16777216") [2025-04-21 14:09:56.007150] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(tmpdir="") [2025-04-21 14:09:56.007166] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(unique_checks="1") [2025-04-21 14:09:56.007183] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(version_compile_machine="") [2025-04-21 14:09:56.007199] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(version_compile_os="") [2025-04-21 14:09:56.007215] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(warning_count="0") [2025-04-21 14:09:56.007231] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(session_track_schema="1") [2025-04-21 14:09:56.007248] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(session_track_system_variables="time_zone, autocommit, character_set_client, character_set_results, character_set_connection") [2025-04-21 14:09:56.007264] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(session_track_state_change="0") [2025-04-21 14:09:56.007281] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(have_query_cache="NO") [2025-04-21 14:09:56.007299] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(query_cache_limit="0") [2025-04-21 14:09:56.007315] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(query_cache_min_res_unit="0") [2025-04-21 14:09:56.007332] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_cache_wlock_invalidate="0") [2025-04-21 14:09:56.007348] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_format="2") [2025-04-21 14:09:56.007365] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_checksum="CRC32") [2025-04-21 14:09:56.007381] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_rows_query_log_events="0") [2025-04-21 14:09:56.007397] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(log_bin="1") [2025-04-21 14:09:56.007413] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(server_uuid="c8f3867c-1e76-11f0-ba84-fefcfe2fc524") [2025-04-21 14:09:56.007430] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(default_storage_engine="OceanBase") [2025-04-21 14:09:56.007448] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(cte_max_recursion_depth="1000") [2025-04-21 14:09:56.007464] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(regexp_stack_limit="8000000") [2025-04-21 14:09:56.007481] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(regexp_time_limit="32") [2025-04-21 14:09:56.007497] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(profiling="0") [2025-04-21 14:09:56.007514] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(profiling_history_size="15") [2025-04-21 14:09:56.007531] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_interm_result_mem_limit="2147483648") [2025-04-21 14:09:56.007548] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_proxy_partition_hit="1") [2025-04-21 14:09:56.007564] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_log_level="disabled") [2025-04-21 14:09:56.007581] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_query_timeout="10000000") [2025-04-21 14:09:56.007597] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_read_consistency="3") [2025-04-21 14:09:56.007614] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_enable_transformation="1") [2025-04-21 14:09:56.007630] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_trx_timeout="86400000000") [2025-04-21 14:09:56.007646] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_plan_cache="1") [2025-04-21 14:09:56.007663] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_enable_index_direct_select="0") [2025-04-21 14:09:56.007680] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_proxy_set_trx_executed="0") [2025-04-21 14:09:56.007697] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_aggregation_pushdown="1") [2025-04-21 14:09:56.007714] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_last_schema_version="0") [2025-04-21 14:09:56.007731] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_global_debug_sync="") [2025-04-21 14:09:56.007746] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_proxy_global_variables_version="0") [2025-04-21 14:09:56.007758] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=10] load default system variable(ob_enable_show_trace="0") [2025-04-21 14:09:56.007771] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=10] load default system variable(ob_bnl_join_cache_size="10485760") [2025-04-21 14:09:56.007786] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_proxy_user_privilege="0") [2025-04-21 14:09:56.007802] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_org_cluster_id="0") [2025-04-21 14:09:56.007832] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=28] load default system variable(ob_plan_cache_percentage="5") [2025-04-21 14:09:56.007849] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_plan_cache_evict_high_percentage="90") [2025-04-21 14:09:56.007866] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_plan_cache_evict_low_percentage="50") [2025-04-21 14:09:56.007883] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(recyclebin="0") [2025-04-21 14:09:56.007899] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_capability_flag="0") [2025-04-21 14:09:56.007916] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(is_result_accurate="1") [2025-04-21 14:09:56.007933] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(error_on_overlap_time="0") [2025-04-21 14:09:56.007950] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_compatibility_mode="0") [2025-04-21 14:09:56.007966] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_sql_work_area_percentage="5") [2025-04-21 14:09:56.007982] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_safe_weak_read_snapshot="1") [2025-04-21 14:09:56.007998] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_route_policy="1") [2025-04-21 14:09:56.008014] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_transmission_checksum="1") [2025-04-21 14:09:56.008031] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(foreign_key_checks="1") [2025-04-21 14:09:56.008047] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_statement_trace_id="Y0-0") [2025-04-21 14:09:56.008064] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_truncate_flashback="0") [2025-04-21 14:09:56.008080] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_tcp_invited_nodes="127.0.0.1,::1") [2025-04-21 14:09:56.008096] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(sql_throttle_current_priority="100") [2025-04-21 14:09:56.008113] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_throttle_priority="-1") [2025-04-21 14:09:56.008125] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=10] load default system variable(sql_throttle_rt="-1") [2025-04-21 14:09:56.008142] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_throttle_cpu="-1") [2025-04-21 14:09:56.008158] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_throttle_io="-1") [2025-04-21 14:09:56.008174] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_throttle_network="-1") [2025-04-21 14:09:56.008191] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_throttle_logical_reads="-1") [2025-04-21 14:09:56.008207] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(auto_increment_cache_size="1000000") [2025-04-21 14:09:56.008223] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_enable_jit="0") [2025-04-21 14:09:56.008239] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_temp_tablespace_size_percentage="0") [2025-04-21 14:09:56.008255] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(plugin_dir="./plugin_dir/") [2025-04-21 14:09:56.008272] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_sql_audit_percentage="3") [2025-04-21 14:09:56.008288] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_sql_audit="1") [2025-04-21 14:09:56.008305] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(optimizer_use_sql_plan_baselines="0") [2025-04-21 14:09:56.008322] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(optimizer_capture_sql_plan_baselines="0") [2025-04-21 14:09:56.008339] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(parallel_servers_target="0") [2025-04-21 14:09:56.008355] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_early_lock_release="0") [2025-04-21 14:09:56.008371] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_trx_idle_timeout="86400000000") [2025-04-21 14:09:56.008388] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(block_encryption_mode="0") [2025-04-21 14:09:56.008412] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(nls_date_format="DD-MON-RR") [2025-04-21 14:09:56.008438] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(nls_timestamp_format="DD-MON-RR HH.MI.SSXFF AM") [2025-04-21 14:09:56.008465] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_timestamp_tz_format="DD-MON-RR HH.MI.SSXFF AM TZR") [2025-04-21 14:09:56.008481] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_reserved_meta_memory_percentage="10") [2025-04-21 14:09:56.008497] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_check_sys_variable="1") [2025-04-21 14:09:56.008514] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(nls_language="AMERICAN") [2025-04-21 14:09:56.008530] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_territory="AMERICA") [2025-04-21 14:09:56.008547] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_sort="BINARY") [2025-04-21 14:09:56.008563] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_comp="BINARY") [2025-04-21 14:09:56.008579] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_characterset="AL32UTF8") [2025-04-21 14:09:56.008596] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_nchar_characterset="AL16UTF16") [2025-04-21 14:09:56.008612] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_date_language="AMERICAN") [2025-04-21 14:09:56.008628] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_length_semantics="BYTE") [2025-04-21 14:09:56.008644] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_nchar_conv_excp="FALSE") [2025-04-21 14:09:56.008660] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_calendar="GREGORIAN") [2025-04-21 14:09:56.008676] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_numeric_characters=".,") [2025-04-21 14:09:56.008692] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_nlj_batching_enabled="1") [2025-04-21 14:09:56.008708] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(tracefile_identifier="") [2025-04-21 14:09:56.008724] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_groupby_nopushdown_cut_ratio="3") [2025-04-21 14:09:56.008740] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_px_broadcast_fudge_factor="100") [2025-04-21 14:09:56.008756] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(transaction_isolation="READ-COMMITTED") [2025-04-21 14:09:56.008781] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=23] load default system variable(ob_trx_lock_timeout="-1") [2025-04-21 14:09:56.008799] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(validate_password_check_user_name="0") [2025-04-21 14:09:56.008818] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=17] load default system variable(validate_password_length="0") [2025-04-21 14:09:56.008906] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=84] load default system variable(validate_password_mixed_case_count="0") [2025-04-21 14:09:56.008924] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(validate_password_number_count="0") [2025-04-21 14:09:56.008940] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(validate_password_policy="0") [2025-04-21 14:09:56.008956] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(validate_password_special_char_count="0") [2025-04-21 14:09:56.008972] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(default_password_lifetime="0") [2025-04-21 14:09:56.008989] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_ob_ols_policy_session_labels="") [2025-04-21 14:09:56.009020] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=27] load default system variable(ob_trace_info="") [2025-04-21 14:09:56.009039] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=17] load default system variable(_px_partition_scan_threshold="64") [2025-04-21 14:09:56.009056] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_ob_px_bcast_optimization="1") [2025-04-21 14:09:56.009072] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_ob_px_slave_mapping_threshold="200") [2025-04-21 14:09:56.009089] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_enable_parallel_dml="0") [2025-04-21 14:09:56.009105] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_px_min_granules_per_slave="13") [2025-04-21 14:09:56.009121] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(secure_file_priv="") [2025-04-21 14:09:56.009137] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(plsql_warnings="ENABLE:ALL") [2025-04-21 14:09:56.009157] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_enable_parallel_query="1") [2025-04-21 14:09:56.009173] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_force_parallel_query_dop="1") [2025-04-21 14:09:56.009190] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_force_parallel_dml_dop="1") [2025-04-21 14:09:56.009207] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_pl_block_timeout="3216672000000000") [2025-04-21 14:09:56.009223] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(transaction_read_only="0") [2025-04-21 14:09:56.009239] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(resource_manager_plan="") [2025-04-21 14:09:56.009255] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(performance_schema="0") [2025-04-21 14:09:56.009271] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(nls_currency="$") [2025-04-21 14:09:56.009291] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(nls_iso_currency="AMERICA") [2025-04-21 14:09:56.009307] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(nls_dual_currency="$") [2025-04-21 14:09:56.009323] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(plsql_ccflags="") [2025-04-21 14:09:56.009340] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_ob_proxy_session_temporary_table_used="0") [2025-04-21 14:09:56.009356] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_enable_parallel_ddl="1") [2025-04-21 14:09:56.009373] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_force_parallel_ddl_dop="1") [2025-04-21 14:09:56.009389] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(cursor_sharing="0") [2025-04-21 14:09:56.009405] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_optimizer_null_aware_antijoin="1") [2025-04-21 14:09:56.009422] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_px_partial_rollup_pushdown="1") [2025-04-21 14:09:56.009437] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_px_dist_agg_partial_rollup_pushdown="1") [2025-04-21 14:09:56.009453] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_create_audit_purge_job="") [2025-04-21 14:09:56.009469] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_drop_audit_purge_job="") [2025-04-21 14:09:56.009486] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_set_purge_job_interval="") [2025-04-21 14:09:56.009502] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_set_purge_job_status="") [2025-04-21 14:09:56.009519] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_set_last_archive_timestamp="") [2025-04-21 14:09:56.009535] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_clear_last_archive_timestamp="") [2025-04-21 14:09:56.009552] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_aggregation_optimization_settings="0") [2025-04-21 14:09:56.009568] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_px_shared_hash_join="1") [2025-04-21 14:09:56.009585] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(sql_notes="0") [2025-04-21 14:09:56.009603] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_strict_mode="1") [2025-04-21 14:09:56.009621] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_windowfunc_optimization_settings="0") [2025-04-21 14:09:56.009638] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_enable_rich_error_msg="0") [2025-04-21 14:09:56.009654] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(log_row_value_options="") [2025-04-21 14:09:56.009671] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_max_read_stale_time="-1") [2025-04-21 14:09:56.009687] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_optimizer_gather_stats_on_load="1") [2025-04-21 14:09:56.009703] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_set_reverse_dblink_infos="") [2025-04-21 14:09:56.009719] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_force_order_preserve_set="0") [2025-04-21 14:09:56.009735] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(_show_ddl_in_compat_mode="0") [2025-04-21 14:09:56.009751] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(parallel_degree_policy="0") [2025-04-21 14:09:56.009767] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(parallel_degree_limit="0") [2025-04-21 14:09:56.009784] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(parallel_min_scan_time_threshold="1000") [2025-04-21 14:09:56.009800] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_dynamic_sampling="1") [2025-04-21 14:09:56.009818] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(runtime_filter_type="BLOOM_FILTER,RANGE,IN") [2025-04-21 14:09:56.009844] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(runtime_filter_wait_time_ms="10") [2025-04-21 14:09:56.009861] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(runtime_filter_max_in_num="1024") [2025-04-21 14:09:56.009878] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(runtime_bloom_filter_max_size="2147483648") [2025-04-21 14:09:56.009898] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(optimizer_features_enable="4.3.4.0") [2025-04-21 14:09:56.009915] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_ob_proxy_weakread_feedback="0") [2025-04-21 14:09:56.009932] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ncharacter_set_connection="0") [2025-04-21 14:09:56.009948] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(automatic_sp_privileges="1") [2025-04-21 14:09:56.009964] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(privilege_features_enable="") [2025-04-21 14:09:56.009981] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_priv_control="") [2025-04-21 14:09:56.009997] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_enable_mysql_pl_priv_check="0") [2025-04-21 14:09:56.010013] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_enable_pl_cache="1") [2025-04-21 14:09:56.010029] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_default_lob_inrow_threshold="8192") [2025-04-21 14:09:56.010045] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_enable_storage_cardinality_estimation="1") [2025-04-21 14:09:56.010062] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(lc_time_names="en_US") [2025-04-21 14:09:56.010078] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(activate_all_roles_on_login="0") [2025-04-21 14:09:56.010095] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_enable_rich_vector_format="1") [2025-04-21 14:09:56.010111] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_stats_persistent="1") [2025-04-21 14:09:56.010129] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(debug="d:t:i:o,/tmp/mysqld.trace") [2025-04-21 14:09:56.010145] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_change_buffering_debug="0") [2025-04-21 14:09:56.010162] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_compress_debug="0") [2025-04-21 14:09:56.010178] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_disable_resize_buffer_pool_debug="1") [2025-04-21 14:09:56.010196] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_fil_make_page_dirty_debug="0") [2025-04-21 14:09:56.010213] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_limit_optimistic_insert_debug="0") [2025-04-21 14:09:56.010229] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_merge_threshold_set_all_debug="50") [2025-04-21 14:09:56.010246] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_saved_page_number_debug="0") [2025-04-21 14:09:56.010262] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_trx_purge_view_update_only_debug="0") [2025-04-21 14:09:56.010278] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(innodb_trx_rseg_n_slots_debug="0") [2025-04-21 14:09:56.010295] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(stored_program_cache="256") [2025-04-21 14:09:56.010319] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_compatibility_control="0") [2025-04-21 14:09:56.010336] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ob_compatibility_version="17180000512") [2025-04-21 14:09:56.010353] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_security_version="17180000512") [2025-04-21 14:09:56.010369] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(cardinality_estimation_model="1") [2025-04-21 14:09:56.010386] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_rewrite_enabled="0") [2025-04-21 14:09:56.010402] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_rewrite_integrity="0") [2025-04-21 14:09:56.010418] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(flush="0") [2025-04-21 14:09:56.010442] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=21] load default system variable(flush_time="0") [2025-04-21 14:09:56.010459] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_adaptive_flushing="1") [2025-04-21 14:09:56.010476] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_adaptive_flushing_lwm="10") [2025-04-21 14:09:56.010500] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=22] load default system variable(innodb_adaptive_hash_index="1") [2025-04-21 14:09:56.010518] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_adaptive_hash_index_parts="8") [2025-04-21 14:09:56.010535] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_adaptive_max_sleep_delay="150000") [2025-04-21 14:09:56.010559] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=21] load default system variable(innodb_autoextend_increment="64") [2025-04-21 14:09:56.010576] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_background_drop_list_empty="0") [2025-04-21 14:09:56.010593] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_buffer_pool_dump_at_shutdown="1") [2025-04-21 14:09:56.010610] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_dump_now="0") [2025-04-21 14:09:56.010627] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_dump_pct="25") [2025-04-21 14:09:56.010644] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_filename="ib_buffer_pool") [2025-04-21 14:09:56.010660] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_load_abort="0") [2025-04-21 14:09:56.010677] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_buffer_pool_load_now="0") [2025-04-21 14:09:56.010705] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=24] load default system variable(innodb_buffer_pool_size="134217728") [2025-04-21 14:09:56.010722] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_change_buffer_max_size="25") [2025-04-21 14:09:56.010739] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_change_buffering="5") [2025-04-21 14:09:56.010755] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_checksum_algorithm="0") [2025-04-21 14:09:56.010772] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_cmp_per_index_enabled="0") [2025-04-21 14:09:56.010789] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_commit_concurrency="0") [2025-04-21 14:09:56.010805] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_compression_failure_threshold_pct="5") [2025-04-21 14:09:56.010822] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_compression_level="6") [2025-04-21 14:09:56.010839] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_compression_pad_pct_max="50") [2025-04-21 14:09:56.010856] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_concurrency_tickets="5000") [2025-04-21 14:09:56.010873] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_default_row_format="2") [2025-04-21 14:09:56.010889] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_disable_sort_file_cache="0") [2025-04-21 14:09:56.010906] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_file_format="1") [2025-04-21 14:09:56.010923] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_file_format_max="1") [2025-04-21 14:09:56.010940] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_file_per_table="1") [2025-04-21 14:09:56.010957] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_fill_factor="100") [2025-04-21 14:09:56.010972] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_flush_neighbors="1") [2025-04-21 14:09:56.010988] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_flush_sync="1") [2025-04-21 14:09:56.011005] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_flushing_avg_loops="30") [2025-04-21 14:09:56.011033] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26] load default system variable(innodb_lru_scan_depth="1024") [2025-04-21 14:09:56.011052] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_max_dirty_pages_pct="75") [2025-04-21 14:09:56.011069] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_max_dirty_pages_pct_lwm="0") [2025-04-21 14:09:56.011086] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_max_purge_lag="0") [2025-04-21 14:09:56.011102] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_max_purge_lag_delay="0") [2025-04-21 14:09:56.011119] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(have_symlink="1") [2025-04-21 14:09:56.011136] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ignore_builtin_innodb="0") [2025-04-21 14:09:56.011153] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_chunk_size="134217728") [2025-04-21 14:09:56.011170] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_instances="8") [2025-04-21 14:09:56.011187] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_buffer_pool_load_at_startup="1") [2025-04-21 14:09:56.011203] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_checksums="1") [2025-04-21 14:09:56.011219] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_doublewrite="1") [2025-04-21 14:09:56.011235] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_file_format_check="1") [2025-04-21 14:09:56.011251] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_flush_method="0") [2025-04-21 14:09:56.011267] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_force_load_corrupted="0") [2025-04-21 14:09:56.011284] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_page_size="2") [2025-04-21 14:09:56.011301] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_version="0") [2025-04-21 14:09:56.011318] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(myisam_mmap_size="18446744073709551615") [2025-04-21 14:09:56.011334] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(table_open_cache_instances="16") [2025-04-21 14:09:56.011351] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_executed="") [2025-04-21 14:09:56.011367] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_owned="") [2025-04-21 14:09:56.011383] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_rollback_on_timeout="0") [2025-04-21 14:09:56.011400] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(completion_type="0") [2025-04-21 14:09:56.011416] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(enforce_gtid_consistency="0") [2025-04-21 14:09:56.011432] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_executed_compression_period="1000") [2025-04-21 14:09:56.011448] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_mode="0") [2025-04-21 14:09:56.011464] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_next="0") [2025-04-21 14:09:56.011480] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(gtid_purged="") [2025-04-21 14:09:56.011496] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_api_bk_commit_interval="5") [2025-04-21 14:09:56.011512] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_api_trx_level="0") [2025-04-21 14:09:56.011528] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_support_xa="1") [2025-04-21 14:09:56.011545] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(session_track_gtids="0") [2025-04-21 14:09:56.011561] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(session_track_transaction_info="0") [2025-04-21 14:09:56.011577] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(transaction_alloc_block_size="8192") [2025-04-21 14:09:56.011593] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(transaction_allow_batching="0") [2025-04-21 14:09:56.011609] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(transaction_prealloc_size="4096") [2025-04-21 14:09:56.011628] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=17] load default system variable(transaction_write_set_extraction="0") [2025-04-21 14:09:56.011640] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=11] load default system variable(information_schema_stats_expiry="86400") [2025-04-21 14:09:56.011654] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=11] load default system variable(_oracle_sql_select_limit="9223372036854775807") [2025-04-21 14:09:56.011671] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_allow_local_disjoint_gtids_join="0") [2025-04-21 14:09:56.011684] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=11] load default system variable(group_replication_allow_local_lower_version_join="0") [2025-04-21 14:09:56.011701] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_auto_increment_increment="7") [2025-04-21 14:09:56.011717] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_bootstrap_group="0") [2025-04-21 14:09:56.011734] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_components_stop_timeout="31536000") [2025-04-21 14:09:56.011751] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_compression_threshold="1000000") [2025-04-21 14:09:56.011767] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_enforce_update_everywhere_checks="0") [2025-04-21 14:09:56.011783] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_exit_state_action="1") [2025-04-21 14:09:56.011800] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_flow_control_applier_threshold="25000") [2025-04-21 14:09:56.011818] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(group_replication_flow_control_certifier_threshold="25000") [2025-04-21 14:09:56.011836] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_flow_control_mode="1") [2025-04-21 14:09:56.011853] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(group_replication_force_members="") [2025-04-21 14:09:56.011871] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_group_name="") [2025-04-21 14:09:56.011888] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_gtid_assignment_block_size="") [2025-04-21 14:09:56.011906] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_ip_whitelist="AUTOMATIC") [2025-04-21 14:09:56.011922] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_local_address="") [2025-04-21 14:09:56.011938] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_member_weight="50") [2025-04-21 14:09:56.011954] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_poll_spin_loops="0") [2025-04-21 14:09:56.011971] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_complete_at="1") [2025-04-21 14:09:56.011987] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_reconnect_interval="60") [2025-04-21 14:09:56.012004] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_retry_count="10") [2025-04-21 14:09:56.012020] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_ca="") [2025-04-21 14:09:56.012038] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_capath="") [2025-04-21 14:09:56.012054] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_cert="") [2025-04-21 14:09:56.012071] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_cipher="") [2025-04-21 14:09:56.012087] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_crl="") [2025-04-21 14:09:56.012104] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_crlpath="") [2025-04-21 14:09:56.012120] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_key="") [2025-04-21 14:09:56.012136] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_ssl_verify_server_cert="0") [2025-04-21 14:09:56.012153] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_recovery_use_ssl="0") [2025-04-21 14:09:56.012170] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_single_primary_mode="0") [2025-04-21 14:09:56.012187] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_ssl_mode="0") [2025-04-21 14:09:56.012203] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_start_on_boot="0") [2025-04-21 14:09:56.012221] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_transaction_size_limit="0") [2025-04-21 14:09:56.012237] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(group_replication_unreachable_majority_timeout="0") [2025-04-21 14:09:56.012254] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_replication_delay="0") [2025-04-21 14:09:56.012270] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(master_info_repository="FILE") [2025-04-21 14:09:56.012286] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(master_verify_checksum="0") [2025-04-21 14:09:56.012302] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(pseudo_slave_mode="0") [2025-04-21 14:09:56.012319] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(pseudo_thread_id="2147483647") [2025-04-21 14:09:56.012335] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rbr_exec_mode="0") [2025-04-21 14:09:56.012351] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(replication_optimize_for_static_plugin_config="0") [2025-04-21 14:09:56.012367] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(replication_sender_observe_commit_only="0") [2025-04-21 14:09:56.012384] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rpl_semi_sync_master_enabled="0") [2025-04-21 14:09:56.012401] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rpl_semi_sync_master_timeout="10000") [2025-04-21 14:09:56.012419] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rpl_semi_sync_master_trace_level="32") [2025-04-21 14:09:56.012436] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rpl_semi_sync_master_wait_for_slave_count="1") [2025-04-21 14:09:56.012452] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rpl_semi_sync_master_wait_no_slave="0") [2025-04-21 14:09:56.012468] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(rpl_semi_sync_master_wait_point="0") [2025-04-21 14:09:56.012484] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rpl_semi_sync_slave_enabled="0") [2025-04-21 14:09:56.012501] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rpl_semi_sync_slave_trace_level="32") [2025-04-21 14:09:56.012517] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rpl_stop_slave_timeout="31536000") [2025-04-21 14:09:56.012533] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_allow_batching="0") [2025-04-21 14:09:56.012550] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_checkpoint_group="512") [2025-04-21 14:09:56.012568] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_checkpoint_period="300") [2025-04-21 14:09:56.012584] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_compressed_protocol="0") [2025-04-21 14:09:56.012610] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=23] load default system variable(slave_exec_mode="0") [2025-04-21 14:09:56.012627] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_max_allowed_packet="1073741824") [2025-04-21 14:09:56.012644] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_net_timeout="60") [2025-04-21 14:09:56.012660] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_parallel_type="0") [2025-04-21 14:09:56.012676] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_parallel_workers="0") [2025-04-21 14:09:56.012693] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_pending_jobs_size_max="16777216") [2025-04-21 14:09:56.012709] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_preserve_commit_order="0") [2025-04-21 14:09:56.012724] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_sql_verify_checksum="0") [2025-04-21 14:09:56.012740] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_transaction_retries="10") [2025-04-21 14:09:56.012756] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_slave_skip_counter="0") [2025-04-21 14:09:56.012772] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_force_recovery="0") [2025-04-21 14:09:56.012789] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(skip_slave_start="0") [2025-04-21 14:09:56.012813] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=22] load default system variable(slave_load_tmpdir="") [2025-04-21 14:09:56.012831] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_skip_errors="OFF") [2025-04-21 14:09:56.012848] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_sync_debug="0") [2025-04-21 14:09:56.012864] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(default_collation_for_utf8mb4="45") [2025-04-21 14:09:56.012881] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(_enable_old_charset_aggregation="0") [2025-04-21 14:09:56.012897] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(enable_sql_plan_monitor="0") [2025-04-21 14:09:56.012914] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(insert_id="0") [2025-04-21 14:09:56.012930] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(join_buffer_size="262144") [2025-04-21 14:09:56.012947] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_join_size="18446744073709547520") [2025-04-21 14:09:56.012964] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_length_for_sort_data="1024") [2025-04-21 14:09:56.012981] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_prepared_stmt_count="16382") [2025-04-21 14:09:56.012998] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_sort_length="1024") [2025-04-21 14:09:56.013027] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26] load default system variable(min_examined_row_limit="0") [2025-04-21 14:09:56.013044] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(multi_range_count="256") [2025-04-21 14:09:56.013061] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysqlx_connect_timeout="30") [2025-04-21 14:09:56.013077] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(mysqlx_idle_worker_thread_timeout="60") [2025-04-21 14:09:56.013093] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysqlx_max_allowed_packet="67108864") [2025-04-21 14:09:56.013109] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysqlx_max_connections="100") [2025-04-21 14:09:56.013125] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysqlx_min_worker_threads="2") [2025-04-21 14:09:56.013142] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(performance_schema_show_processlist="0") [2025-04-21 14:09:56.013157] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_alloc_block_size="8192") [2025-04-21 14:09:56.013174] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(query_prealloc_size="8192") [2025-04-21 14:09:56.013190] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slow_query_log="0") [2025-04-21 14:09:56.013206] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slow_query_log_file="/usr/local/mysql/data/obrd-slow.log") [2025-04-21 14:09:56.013222] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sort_buffer_size="262144") [2025-04-21 14:09:56.013238] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_buffer_result="0") [2025-04-21 14:09:56.013257] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(binlog_cache_size="32768") [2025-04-21 14:09:56.013273] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_direct_non_transactional_updates="0") [2025-04-21 14:09:56.013291] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_error_action="1") [2025-04-21 14:09:56.013320] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=27] load default system variable(binlog_group_commit_sync_delay="0") [2025-04-21 14:09:56.013337] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(binlog_group_commit_sync_no_delay_count="0") [2025-04-21 14:09:56.013355] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(binlog_max_flush_queue_time="0") [2025-04-21 14:09:56.013380] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=23] load default system variable(binlog_order_commits="1") [2025-04-21 14:09:56.013397] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(binlog_stmt_cache_size="32768") [2025-04-21 14:09:56.013413] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_transaction_dependency_history_size="25000") [2025-04-21 14:09:56.013429] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(binlog_transaction_dependency_tracking="0") [2025-04-21 14:09:56.013446] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(expire_logs_days="0") [2025-04-21 14:09:56.013462] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_flush_log_at_timeout="1") [2025-04-21 14:09:56.013478] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_flush_log_at_trx_commit="1") [2025-04-21 14:09:56.013494] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_log_checkpoint_now="0") [2025-04-21 14:09:56.013510] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_log_checksums="1") [2025-04-21 14:09:56.013526] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_log_compressed_pages="1") [2025-04-21 14:09:56.013542] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_log_write_ahead_size="8192") [2025-04-21 14:09:56.013558] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_max_undo_log_size="1073741824") [2025-04-21 14:09:56.013575] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_online_alter_log_max_size="134217728") [2025-04-21 14:09:56.013591] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_undo_log_truncate="0") [2025-04-21 14:09:56.013606] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_undo_logs="128") [2025-04-21 14:09:56.013623] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(log_bin_trust_function_creators="0") [2025-04-21 14:09:56.013640] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(log_bin_use_v1_row_events="0") [2025-04-21 14:09:56.013656] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(log_builtin_as_identified_by_password="0") [2025-04-21 14:09:56.013672] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_binlog_cache_size="18446744073709500416") [2025-04-21 14:09:56.013688] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_binlog_size="1073741824") [2025-04-21 14:09:56.013704] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_binlog_stmt_cache_size="18446744073709500416") [2025-04-21 14:09:56.013720] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_relay_log_size="0") [2025-04-21 14:09:56.013737] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(relay_log_info_repository="FILE") [2025-04-21 14:09:56.013753] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(relay_log_purge="1") [2025-04-21 14:09:56.013769] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sync_binlog="1") [2025-04-21 14:09:56.013786] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sync_relay_log="10000") [2025-04-21 14:09:56.013803] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sync_relay_log_info="10000") [2025-04-21 14:09:56.013819] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_deadlock_detect="1") [2025-04-21 14:09:56.013835] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_lock_wait_timeout="50") [2025-04-21 14:09:56.013852] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_print_all_deadlocks="0") [2025-04-21 14:09:56.013869] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_table_locks="1") [2025-04-21 14:09:56.013885] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_write_lock_count="18446744073709500416") [2025-04-21 14:09:56.013902] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(_ob_enable_role_ids="") [2025-04-21 14:09:56.013918] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_read_only="0") [2025-04-21 14:09:56.013935] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_api_disable_rowlock="0") [2025-04-21 14:09:56.013951] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_autoinc_lock_mode="1") [2025-04-21 14:09:56.013967] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(skip_external_locking="1") [2025-04-21 14:09:56.013983] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(super_read_only="0") [2025-04-21 14:09:56.014000] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(plsql_optimize_level="2") [2025-04-21 14:09:56.014017] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ft_stopword_file="built-in") [2025-04-21 14:09:56.014033] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_ft_cache_size="8000000") [2025-04-21 14:09:56.014050] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_ft_sort_pll_degree="2") [2025-04-21 14:09:56.014067] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_ft_total_cache_size="640000000") [2025-04-21 14:09:56.014083] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(mecab_rc_file="") [2025-04-21 14:09:56.014100] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(metadata_locks_cache_size="1024") [2025-04-21 14:09:56.014118] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(metadata_locks_hash_instances="8") [2025-04-21 14:09:56.014136] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_temp_data_file_path="ibtmp1:12M:autoextend") [2025-04-21 14:09:56.014153] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_data_file_path="ibdata1:12M:autoextend") [2025-04-21 14:09:56.014168] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_data_home_dir="") [2025-04-21 14:09:56.014185] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(avoid_temporal_upgrade="0") [2025-04-21 14:09:56.014201] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(default_tmp_storage_engine="0") [2025-04-21 14:09:56.014217] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_ft_enable_diag_print="0") [2025-04-21 14:09:56.014233] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_ft_num_word_optimize="2000") [2025-04-21 14:09:56.014249] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_ft_result_cache_limit="2000000000") [2025-04-21 14:09:56.014266] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_ft_server_stopword_table="") [2025-04-21 14:09:56.014283] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_optimize_fulltext_only="0") [2025-04-21 14:09:56.014300] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(max_tmp_tables="32") [2025-04-21 14:09:56.014316] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_tmpdir="") [2025-04-21 14:09:56.014333] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(group_replication_group_seeds="") [2025-04-21 14:09:56.014349] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(slave_rows_search_algorithms="0") [2025-04-21 14:09:56.014366] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(slave_type_conversions="0") [2025-04-21 14:09:56.014383] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_hnsw_ef_search="64") [2025-04-21 14:09:56.014399] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(delay_key_write="0") [2025-04-21 14:09:56.014415] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_large_prefix="0") [2025-04-21 14:09:56.014432] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(key_buffer_size="8388608") [2025-04-21 14:09:56.014449] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(key_cache_age_threshold="300") [2025-04-21 14:09:56.014466] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(key_cache_division_limit="100") [2025-04-21 14:09:56.014483] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_seeks_for_key="18446744073709551615") [2025-04-21 14:09:56.014500] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(old_alter_table="0") [2025-04-21 14:09:56.014516] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(table_definition_cache="-1") [2025-04-21 14:09:56.014533] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_sort_buffer_size="1048576") [2025-04-21 14:09:56.014549] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(key_cache_block_size="1024") [2025-04-21 14:09:56.014565] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_kv_mode="0") [2025-04-21 14:09:56.014582] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_enable_parameter_anonymous_block="1") [2025-04-21 14:09:56.014599] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(character_sets_dir="") [2025-04-21 14:09:56.014615] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(date_format="%Y-%m-%d") [2025-04-21 14:09:56.014632] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(datetime_format="%Y-%m-%d %H:%i:%s") [2025-04-21 14:09:56.014648] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(disconnect_on_expired_password="1") [2025-04-21 14:09:56.014664] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(external_user="") [2025-04-21 14:09:56.014687] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(have_crypt="YES") [2025-04-21 14:09:56.014706] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=22] load default system variable(have_dynamic_loading="YES") [2025-04-21 14:09:56.014722] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(keyring_aws_conf_file="") [2025-04-21 14:09:56.014737] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(keyring_aws_data_file="") [2025-04-21 14:09:56.014753] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(language="") [2025-04-21 14:09:56.014769] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(lc_messages_dir="") [2025-04-21 14:09:56.014785] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(lower_case_file_system="0") [2025-04-21 14:09:56.014801] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_digest_length="1024") [2025-04-21 14:09:56.014817] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndbinfo_database="ndbinfo") [2025-04-21 14:09:56.014833] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndbinfo_table_prefix="ndb$") [2025-04-21 14:09:56.014849] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndbinfo_version="") [2025-04-21 14:09:56.014865] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_batch_size="32768") [2025-04-21 14:09:56.014882] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_cluster_connection_pool="1") [2025-04-21 14:09:56.014897] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_cluster_connection_pool_nodeids="") [2025-04-21 14:09:56.014914] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_log_apply_status="0") [2025-04-21 14:09:56.014930] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_log_bin="1") [2025-04-21 14:09:56.014946] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_log_fail_terminate="0") [2025-04-21 14:09:56.014963] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ndb_log_orig="0") [2025-04-21 14:09:56.014978] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_log_transaction_id="0") [2025-04-21 14:09:56.014994] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_optimized_node_selection="3") [2025-04-21 14:09:56.015011] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(Ndb_system_name="") [2025-04-21 14:09:56.015027] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ndb_use_copying_alter_table="0") [2025-04-21 14:09:56.015044] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_version_string="") [2025-04-21 14:09:56.015060] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(ndb_wait_connected="30") [2025-04-21 14:09:56.015077] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_wait_setup="30") [2025-04-21 14:09:56.015093] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(proxy_user="") [2025-04-21 14:09:56.015109] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sha256_password_auto_generate_rsa_keys="1") [2025-04-21 14:09:56.015125] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sha256_password_private_key_path="private_key.pem") [2025-04-21 14:09:56.015141] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sha256_password_public_key_path="public_key.pem") [2025-04-21 14:09:56.015158] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(skip_show_database="0") [2025-04-21 14:09:56.015173] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(plugin_load="") [2025-04-21 14:09:56.015189] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(plugin_load_add="") [2025-04-21 14:09:56.015205] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(big_tables="0") [2025-04-21 14:09:56.015221] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(check_proxy_users="0") [2025-04-21 14:09:56.015238] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(connection_control_failed_connections_threshold="0") [2025-04-21 14:09:56.015255] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(connection_control_max_connection_delay="2147483647") [2025-04-21 14:09:56.015272] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(connection_control_min_connection_delay="1000") [2025-04-21 14:09:56.015290] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(default_week_format="0") [2025-04-21 14:09:56.015308] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(delayed_insert_timeout="300") [2025-04-21 14:09:56.015327] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(delayed_queue_size="1000") [2025-04-21 14:09:56.015353] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=24] load default system variable(eq_range_index_dive_limit="200") [2025-04-21 14:09:56.015371] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_stats_auto_recalc="1") [2025-04-21 14:09:56.015388] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_stats_include_delete_marked="0") [2025-04-21 14:09:56.015404] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_stats_method="0") [2025-04-21 14:09:56.015421] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_stats_on_metadata="0") [2025-04-21 14:09:56.015437] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(version_tokens_session="") [2025-04-21 14:09:56.015455] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] load default system variable(innodb_stats_persistent_sample_pages="20") [2025-04-21 14:09:56.015472] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(innodb_stats_sample_pages="8") [2025-04-21 14:09:56.015490] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(innodb_stats_transient_sample_pages="8") [2025-04-21 14:09:56.015506] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(keyring_aws_cmk_id="") [2025-04-21 14:09:56.015523] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(keyring_aws_region="19") [2025-04-21 14:09:56.015539] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(keyring_encrypted_file_data="") [2025-04-21 14:09:56.015556] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(keyring_encrypted_file_password="") [2025-04-21 14:09:56.015573] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(keyring_file_data="") [2025-04-21 14:09:56.015589] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(keyring_okv_conf_dir="") [2025-04-21 14:09:56.015604] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(keyring_operations="1") [2025-04-21 14:09:56.015620] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_switch="") [2025-04-21 14:09:56.015638] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(max_connect_errors="100") [2025-04-21 14:09:56.015654] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysql_firewall_mode="0") [2025-04-21 14:09:56.015670] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(mysql_firewall_trace="0") [2025-04-21 14:09:56.015686] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(mysql_native_password_proxy_users="0") [2025-04-21 14:09:56.015703] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(net_retry_count="10") [2025-04-21 14:09:56.015719] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(new="0") [2025-04-21 14:09:56.015736] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(old_passwords="0") [2025-04-21 14:09:56.015752] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_prune_level="1") [2025-04-21 14:09:56.015768] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(optimizer_search_depth="62") [2025-04-21 14:09:56.015784] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_trace="") [2025-04-21 14:09:56.015800] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_trace_features="") [2025-04-21 14:09:56.015816] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_trace_limit="1") [2025-04-21 14:09:56.015832] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(optimizer_trace_max_mem_size="16384") [2025-04-21 14:09:56.015849] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(optimizer_trace_offset="-1") [2025-04-21 14:09:56.015865] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(parser_max_mem_size="18446744073709551615") [2025-04-21 14:09:56.015882] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rand_seed1="0") [2025-04-21 14:09:56.015899] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rand_seed2="0") [2025-04-21 14:09:56.015916] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(range_alloc_block_size="4096") [2025-04-21 14:09:56.015932] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(range_optimizer_max_mem_size="8388608") [2025-04-21 14:09:56.015949] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(rewriter_enabled="1") [2025-04-21 14:09:56.015965] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(rewriter_verbose="0") [2025-04-21 14:09:56.015981] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(secure_auth="1") [2025-04-21 14:09:56.015997] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(sha256_password_proxy_users="0") [2025-04-21 14:09:56.016013] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=13] load default system variable(show_compatibility_56="0") [2025-04-21 14:09:56.016030] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(show_create_table_verbosity="0") [2025-04-21 14:09:56.016045] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(show_old_temporals="0") [2025-04-21 14:09:56.016062] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(sql_big_selects="1") [2025-04-21 14:09:56.016078] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(updatable_views_with_limit="1") [2025-04-21 14:09:56.016094] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(validate_password_dictionary_file="") [2025-04-21 14:09:56.016111] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(delayed_insert_limit="100") [2025-04-21 14:09:56.016127] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ndb_version="") [2025-04-21 14:09:56.016143] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15] load default system variable(auto_generate_certs="1") [2025-04-21 14:09:56.016159] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(range_index_dive_limit="10") [2025-04-21 14:09:56.016175] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(partition_index_dive_limit="10") [2025-04-21 14:09:56.016191] INFO [SQL.SESSION] init_system_variables (ob_basic_session_info.cpp:1148) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] load default system variable(ob_table_access_policy="2") [2025-04-21 14:09:56.017101] INFO [COMMON] ObBaseResourcePool (ob_resource_pool.h:122) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=14] Construction ObResourcePool this=0x56501a30bbc0 type=N9oceanbase8observer20ObInnerSQLConnectionE allocator=0x56501a30bdc0 free_list=0x56501a30bc40 ret=0 bt=0x7bad295 0xe7e49e6 0xe7e3c5b 0xe5b8c5c 0xe5b8af2 0xec187e0 0xec30c1f 0x7bc4068 0x74a606c 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:56.017150] INFO [COMMON] ObResourcePool (ob_resource_pool.h:316) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=31] Construction ObDefaultResourcePool this=0x56501a30bbc0 type=N9oceanbase8observer20ObInnerSQLConnectionE bt=0x7bad295 0xe7e4313 0xe7e3e43 0xe5b8c5c 0xe5b8af2 0xec187e0 0xec30c1f 0x7bc4068 0x74a606c 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:56.017170] INFO [COMMON] get_resource_pool (ob_resource_pool.h:332) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=18] get_resource_pool ptr=0x56501a30bbc0 name=N9oceanbase8observer20ObInnerSQLConnectionE label=RPInnerSqlConn [2025-04-21 14:09:56.025075] INFO [SHARE.SCHEMA] retrieve_routine_schema (ob_schema_retrieve_utils.ipp:3372) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=16] retrieve routine schema succeed(routine_info={tenant_id:1, database_id:201001, package_id:310001, owner_id:200001, routine_id:310051, routine_name:"async_gather_stats_job_proc", overload:0, subprogram_id:50, schema_version:1745214003335080, routine_type:3, flag:16, priv_user:"", comp_flag:0, exec_env:"4194304,45,45,45,", routine_body:"", comment:"", route_sql:"", type_id:-1, routine_params:[]}) [2025-04-21 14:09:56.025132] INFO [SHARE.SCHEMA] retrieve_routine_schema (ob_schema_retrieve_utils.ipp:3382) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=48] retrieve routine infos succeed(tenant_id=1) [2025-04-21 14:09:56.029762] WDIAG [SERVER] get_int (ob_inner_sql_result.cpp:500) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=15][errcode=-4152] get obj error(ret=-4152) [2025-04-21 14:09:56.029891] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=38] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:192}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:56.032002] INFO [COMMON] handle (ob_io_struct.cpp:2969) [619839][T1_DiskCB0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=87] callback runner call handle(get_queue_count()=0, req={is_inited_:true, tenant_id_:1, control_block_:0x7f3c91abf5a0, ref_cnt_:1, raw_buf_:0x7f3bcc0a6150, fd_:{first_id:1152921504606846985, second_id:10, third_id:0, fd_id:-1, slot_version:-1, device_handle:0x7f3c91a4a080}, trace_id_:YB420B1D7AB6-00063343B18EFDFD-0-0, retry_count_:0, tenant_io_mgr_:{ptr:0x7f3c91bf0030}, storage_accesser:{ptr:null}, io_result_:{is_inited_:true, is_finished_:false, is_canceled_:false, has_estimated_:false, complete_size_:4096, offset_:971388, size_:293, timeout_us_:10000000, result_ref_cnt_:2, out_ref_cnt_:1, flag_:{mode:"READ", group_id_:0, func_type_:0, wait_event_id_:1, is_sync_:false, is_unlimited_:false, is_detect_:false, is_write_through_:false, is_sealed_:true, is_time_detect_:false, need_close_dev_and_fd_:false, reserved_:0}, ret_code_:{io_ret_:0, fs_errno_:0}, tenant_id_:1, tenant_io_mgr_:{ptr:0x7f3c91bf0030}, user_data_buf_:null, buf_:null, io_callback_:0x7f3bd15bc080, time_log:{begin_ts:1745215796031284, enqueue_used:9, dequeue_used:38, submit_used:19, return_used:611, callback_enqueue_used:7, callback_dequeue_used:30, callback_finish_used:-1, end_used:-1}}, part_id:-1}) [2025-04-21 14:09:56.032759] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=41] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:192}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:56.033039] INFO [SHARE.SCHEMA] get_batch_routines (ob_schema_service_sql_impl.cpp:3874) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=37] get batch routine info finish(schema_version=1745214003335080, ret=0) [2025-04-21 14:09:56.040016] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=33] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:50197}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=1745215796022444000) [2025-04-21 14:09:56.041484] WDIAG [MDS] get_mds_data_from_tablet (ob_i_tablet_mds_interface.ipp:165) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=45][errcode=-4138] fail to read data from mds sstable(ret=-4138) [2025-04-21 14:09:56.041525] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=35] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:50197}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:56.041574] WDIAG [STORAGE] check_ls_offline (ob_tx_table_interface.cpp:181) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=18][errcode=-4006] tx table is nullptr(ret=-4006, discover_ls_offline=false) [2025-04-21 14:09:56.041667] INFO [SHARE.SCHEMA] retrieve_package_schema (ob_schema_retrieve_utils.ipp:3340) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=27] retrieve package schema succeed(schema={tenant_id:1, database_id:201001, owner_id:200001, package_id:310001, package_name:"dbms_stats", schema_version:1745214002349608, type:1, flag:4, comp_flag:1, exec_env:"4194304,45,45,45,", source:"PACKAGE dbms_stats AUTHID CURRENT_USER DECLARE DEFAULT_METHOD_OPT VARCHAR(1) DEFAULT 'Z'; DECLARE DEFAULT_GRANULARITY VARCHAR(1) DEFAULT 'Z'; DECLARE AUTO_SAMPLE_SIZE DECIMAL(20, 10) DEFAULT 0; DECLARE DEFAULT_STAT_CATEGORY VARCHAR(20) DEFAULT 'OBJECT_STATS'; PROCEDURE gather_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE, hist_est_percent DECIMAL DEFAULT AUTO_SAMPLE_SIZE, hist_block_sample BOOLEAN DEFAULT NULL ); PROCEDURE gather_schema_stats ( ownname VARCHAR(65535), estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE ); PROCEDURE gather_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE set_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numblks DECIMAL(20, 10) DEFAULT NULL, avgrlen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL ); PROCEDURE set_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, distcnt DECIMAL(20, 10) DEFAULT NULL, density DECIMAL(20, 10) DEFAULT NULL, nullcnt DECIMAL(20, 10) DEFAULT NULL, epc DECIMAL(20, 10) DEFAULT NULL, minval TEXT DEFAULT NULL, maxval TEXT DEFAULT NULL, bkvals TEXT DEFAULT NULL, novals TEXT DEFAULT NULL, chvals TEXT DEFAULT NULL, eavals TEXT DEFAULT NULL, rpcnts TEXT DEFAULT NULL, eavs DECIMAL(20, 10) DEFAULT NULL, avgclen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE set_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numlblks DECIMAL(20, 10) DEFAULT NULL, numdist DECIMAL(20, 10) DEFAULT NULL, avglblk DECIMAL(20, 10) DEFAULT NULL, avgdblk DECIMAL(20, 10) DEFAULT NULL, clstfct DECIMAL(20, 10) DEFAULT NULL, indlevel DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, guessq DECIMAL(20, 10) DEFAULT NULL, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, avgrlen DECIMAL(20, 10) DEFAULT NULL, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE delete_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, cascade_columns BOOLEAN DEFAULT TRUE, cascade_indexes BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE delete_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, col_stat_type VARCHAR(65535) DEFAULT 'ALL', degree DECIMAL(20, 10) DEFAULT 1 ); procedure delete_index_stats( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'ALL', force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE delete_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE FLUSH_DATABASE_MONITORING_INFO(); PROCEDURE GATHER_DATABASE_STATS_JOB_PROC(duration BIGINT DEFAULT NULL); PROCEDURE create_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535), tblspace VARCHAR(65535) DEFAULT NULL, global_temporary BOOLEAN DEFAULT FALSE ); PROCEDURE drop_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535) ); PROCEDURE export_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PROCEDURE export_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PROCEDURE export_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PROCEDURE export_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE import_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PROCEDURE import_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE import_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE import_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE lock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE lock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PROCEDURE lock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE unlock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE unlock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PROCEDURE unlock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE restore_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), as_of_timestamp DATETIME(6), restore_cluster_index BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PROCEDURE restore_schema_stats ( ownname VARCHAR(65535), as_of_timestamp DATETIME(6), force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PROCEDURE purge_stats( before_timestamp DATETIME(6) ); PROCEDURE alter_stats_history_retention( retention DECIMAL(20, 10) ); FUNCTION get_stats_history_availability() RETURN DATETIME(6); FUNCTION get_stats_history_retention() RETURN DECIMAL; PROCEDURE reset_global_pref_defaults(); PROCEDURE reset_param_defaults(); PROCEDURE set_global_prefs( pname VARCHAR(65535), pvalue VARCHAR(65535) ); PROCEDURE set_param( pname VARCHAR(65535), pval VARCHAR(65535) ); PROCEDURE set_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PROCEDURE set_table_prefs( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); FUNCTION get_prefs ( pname VARCHAR(65535), ownname VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ) RETURN VARCHAR(65535); FUNCTION get_param ( pname VARCHAR(65535) )RETURN VARCHAR(65535); PROCEDURE delete_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535) ); PROCEDURE delete_table_prefs ( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535) ); PROCEDURE copy_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), srcpartname VARCHAR(65535), dstpartname VARCHAR(65535), scale_factor DECIMAL(20, 10) DEFAULT 1, flags DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE ); PROCEDURE cancel_gather_stats ( taskid VARCHAR(65535) ); PROCEDURE GATHER_SYSTEM_STATS(); PROCEDURE DELETE_SYSTEM_STATS(); PROCEDURE SET_SYSTEM_STATS ( pname VARCHAR(65535), pvalue DECIMAL(20, 10) ); PROCEDURE async_gather_stats_job_proc (duration BIGINT DEFAULT NULL); END dbms_stats", comment:"", route_sql:""}) [2025-04-21 14:09:56.041708] INFO [SHARE.SCHEMA] retrieve_package_schema (ob_schema_retrieve_utils.ipp:3340) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=35] retrieve all package schemas succeed(schema_array=[{tenant_id:1, database_id:201001, owner_id:200001, package_id:310001, package_name:"dbms_stats", schema_version:1745214002349608, type:1, flag:4, comp_flag:1, exec_env:"4194304,45,45,45,", source:"PACKAGE dbms_stats AUTHID CURRENT_USER DECLARE DEFAULT_METHOD_OPT VARCHAR(1) DEFAULT 'Z'; DECLARE DEFAULT_GRANULARITY VARCHAR(1) DEFAULT 'Z'; DECLARE AUTO_SAMPLE_SIZE DECIMAL(20, 10) DEFAULT 0; DECLARE DEFAULT_STAT_CATEGORY VARCHAR(20) DEFAULT 'OBJECT_STATS'; PROCEDURE gather_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE, hist_est_percent DECIMAL DEFAULT AUTO_SAMPLE_SIZE, hist_block_sample BOOLEAN DEFAULT NULL ); PROCEDURE gather_schema_stats ( ownname VARCHAR(65535), estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE ); PROCEDURE gather_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE set_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numblks DECIMAL(20, 10) DEFAULT NULL, avgrlen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL ); PROCEDURE set_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, distcnt DECIMAL(20, 10) DEFAULT NULL, density DECIMAL(20, 10) DEFAULT NULL, nullcnt DECIMAL(20, 10) DEFAULT NULL, epc DECIMAL(20, 10) DEFAULT NULL, minval TEXT DEFAULT NULL, maxval TEXT DEFAULT NULL, bkvals TEXT DEFAULT NULL, novals TEXT DEFAULT NULL, chvals TEXT DEFAULT NULL, eavals TEXT DEFAULT NULL, rpcnts TEXT DEFAULT NULL, eavs DECIMAL(20, 10) DEFAULT NULL, avgclen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE set_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numlblks DECIMAL(20, 10) DEFAULT NULL, numdist DECIMAL(20, 10) DEFAULT NULL, avglblk DECIMAL(20, 10) DEFAULT NULL, avgdblk DECIMAL(20, 10) DEFAULT NULL, clstfct DECIMAL(20, 10) DEFAULT NULL, indlevel DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, guessq DECIMAL(20, 10) DEFAULT NULL, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, avgrlen DECIMAL(20, 10) DEFAULT NULL, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE delete_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, cascade_columns BOOLEAN DEFAULT TRUE, cascade_indexes BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE delete_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, col_stat_type VARCHAR(65535) DEFAULT 'ALL', degree DECIMAL(20, 10) DEFAULT 1 ); procedure delete_index_stats( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'ALL', force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE delete_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PROCEDURE FLUSH_DATABASE_MONITORING_INFO(); PROCEDURE GATHER_DATABASE_STATS_JOB_PROC(duration BIGINT DEFAULT NULL); PROCEDURE create_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535), tblspace VARCHAR(65535) DEFAULT NULL, global_temporary BOOLEAN DEFAULT FALSE ); PROCEDURE drop_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535) ); PROCEDURE export_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PROCEDURE export_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PROCEDURE export_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PROCEDURE export_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE import_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PROCEDURE import_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE import_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PROCEDURE import_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PROCEDURE lock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE lock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PROCEDURE lock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE unlock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE unlock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PROCEDURE unlock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PROCEDURE restore_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), as_of_timestamp DATETIME(6), restore_cluster_index BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PROCEDURE restore_schema_stats ( ownname VARCHAR(65535), as_of_timestamp DATETIME(6), force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PROCEDURE purge_stats( before_timestamp DATETIME(6) ); PROCEDURE alter_stats_history_retention( retention DECIMAL(20, 10) ); FUNCTION get_stats_history_availability() RETURN DATETIME(6); FUNCTION get_stats_history_retention() RETURN DECIMAL; PROCEDURE reset_global_pref_defaults(); PROCEDURE reset_param_defaults(); PROCEDURE set_global_prefs( pname VARCHAR(65535), pvalue VARCHAR(65535) ); PROCEDURE set_param( pname VARCHAR(65535), pval VARCHAR(65535) ); PROCEDURE set_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PROCEDURE set_table_prefs( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); FUNCTION get_prefs ( pname VARCHAR(65535), ownname VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ) RETURN VARCHAR(65535); FUNCTION get_param ( pname VARCHAR(65535) )RETURN VARCHAR(65535); PROCEDURE delete_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535) ); PROCEDURE delete_table_prefs ( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535) ); PROCEDURE copy_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), srcpartname VARCHAR(65535), dstpartname VARCHAR(65535), scale_factor DECIMAL(20, 10) DEFAULT 1, flags DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE ); PROCEDURE cancel_gather_stats ( taskid VARCHAR(65535) ); PROCEDURE GATHER_SYSTEM_STATS(); PROCEDURE DELETE_SYSTEM_STATS(); PROCEDURE SET_SYSTEM_STATS ( pname VARCHAR(65535), pvalue DECIMAL(20, 10) ); PROCEDURE async_gather_stats_job_proc (duration BIGINT DEFAULT NULL); END dbms_stats", comment:"", route_sql:""}]) [2025-04-21 14:09:56.041802] INFO [SHARE.SCHEMA] get_batch_packages (ob_schema_service_sql_impl.cpp:4059) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26] get batch package info finish(schema_version=1745214002349608, ret=0) [2025-04-21 14:09:56.045056] INFO [STORAGE.BLKMGR] runTimerTask (ob_block_manager.cpp:1646) [619599][BlkMgr][T0][Y0-0000000000000000-0-0] [lt=51] skip inspect bad block(last_check_time=1745215599921837, last_macro_idx=-1) [2025-04-21 14:09:56.045456] WDIAG [STORAGE] check_ls_offline (ob_tx_table_interface.cpp:181) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=26][errcode=-4006] tx table is nullptr(ret=-4006, discover_ls_offline=false) [2025-04-21 14:09:56.045543] INFO [SHARE.SCHEMA] retrieve_package_schema (ob_schema_retrieve_utils.ipp:3340) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=38] retrieve package schema succeed(schema={tenant_id:1, database_id:201001, owner_id:200001, package_id:310052, package_name:"dbms_stats", schema_version:1745214003275840, type:2, flag:4, comp_flag:1, exec_env:"4194304,45,45,45,", source:"PACKAGE BODY dbms_stats PROCEDURE gather_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE, hist_est_percent DECIMAL DEFAULT AUTO_SAMPLE_SIZE, hist_block_sample BOOLEAN DEFAULT NULL ); PRAGMA INTERFACE(C, GATHER_TABLE_STATS); PROCEDURE gather_schema_stats ( ownname VARCHAR(65535), estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, GATHER_SCHEMA_STATS); PROCEDURE gather_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, GATHER_INDEX_STATS); PROCEDURE set_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numblks DECIMAL(20, 10) DEFAULT NULL, avgrlen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL ); PRAGMA INTERFACE(C, SET_TABLE_STATS); PROCEDURE set_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, distcnt DECIMAL(20, 10) DEFAULT NULL, density DECIMAL(20, 10) DEFAULT NULL, nullcnt DECIMAL(20, 10) DEFAULT NULL, epc DECIMAL(20, 10) DEFAULT NULL, minval TEXT DEFAULT NULL, maxval TEXT DEFAULT NULL, bkvals TEXT DEFAULT NULL, novals TEXT DEFAULT NULL, chvals TEXT DEFAULT NULL, eavals TEXT DEFAULT NULL, rpcnts TEXT DEFAULT NULL, eavs DECIMAL(20, 10) DEFAULT NULL, avgclen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, SET_COLUMN_STATS); PROCEDURE set_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numlblks DECIMAL(20, 10) DEFAULT NULL, numdist DECIMAL(20, 10) DEFAULT NULL, avglblk DECIMAL(20, 10) DEFAULT NULL, avgdblk DECIMAL(20, 10) DEFAULT NULL, clstfct DECIMAL(20, 10) DEFAULT NULL, indlevel DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, guessq DECIMAL(20, 10) DEFAULT NULL, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, avgrlen DECIMAL(20, 10) DEFAULT NULL, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, SET_INDEX_STATS); PROCEDURE delete_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, cascade_columns BOOLEAN DEFAULT TRUE, cascade_indexes BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_TABLE_STATS); PROCEDURE delete_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, col_stat_type VARCHAR(65535) DEFAULT 'ALL', degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_COLUMN_STATS); procedure delete_index_stats( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'ALL', force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_INDEX_STATS); PROCEDURE delete_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_SCHEMA_STATS); PROCEDURE FLUSH_DATABASE_MONITORING_INFO(); PRAGMA INTERFACE(C, FLUSH_DATABASE_MONITORING_INFO); PROCEDURE GATHER_DATABASE_STATS_JOB_PROC(duration BIGINT DEFAULT NULL); PRAGMA INTERFACE(C, GATHER_DATABASE_STATS_JOB_PROC); PROCEDURE create_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535), tblspace VARCHAR(65535) DEFAULT NULL, global_temporary BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, CREATE_STAT_TABLE); PROCEDURE drop_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535) ); PRAGMA INTERFACE(C, DROP_STAT_TABLE); PROCEDURE export_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PRAGMA INTERFACE(C, EXPORT_TABLE_STATS); PROCEDURE export_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_COLUMN_STATS); PROCEDURE export_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_SCHEMA_STATS); PROCEDURE export_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_INDEX_STATS); PROCEDURE import_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PRAGMA INTERFACE(C, IMPORT_TABLE_STATS); PROCEDURE import_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, IMPORT_COLUMN_STATS); PROCEDURE import_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, IMPORT_SCHEMA_STATS); PROCEDURE import_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, IMPORT_INDEX_STATS); PROCEDURE lock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, LOCK_TABLE_STATS); PROCEDURE lock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PRAGMA INTERFACE(C, LOCK_PARTITION_STATS); PROCEDURE lock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, LOCK_SCHEMA_STATS); PROCEDURE unlock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, UNLOCK_TABLE_STATS); PROCEDURE unlock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PRAGMA INTERFACE(C, UNLOCK_PARTITION_STATS); PROCEDURE unlock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, UNLOCK_SCHEMA_STATS); PROCEDURE restore_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), as_of_timestamp DATETIME(6), restore_cluster_index BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, RESTORE_TABLE_STATS); PROCEDURE restore_schema_stats ( ownname VARCHAR(65535), as_of_timestamp DATETIME(6), force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, RESTORE_SCHEMA_STATS); PROCEDURE purge_stats( before_timestamp DATETIME(6) ); PRAGMA INTERFACE(C, PURGE_STATS); PROCEDURE alter_stats_history_retention( retention DECIMAL(20, 10) ); PRAGMA INTERFACE(C, ALTER_STATS_HISTORY_RETENTION); FUNCTION get_stats_history_availability() RETURN DATETIME(6); PRAGMA INTERFACE(C, GET_STATS_HISTORY_AVAILABILITY); FUNCTION get_stats_history_retention() RETURN DECIMAL; PRAGMA INTERFACE(C, GET_STATS_HISTORY_RETENTION); PROCEDURE reset_global_pref_defaults(); PRAGMA INTERFACE(C, RESET_GLOBAL_PREF_DEFAULTS); PROCEDURE reset_param_defaults() BEGIN call reset_global_pref_defaults(); END; PROCEDURE set_global_prefs( pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_GLOBAL_PREFS); PROCEDURE set_param(pname VARCHAR(65535), pval VARCHAR(65535)) BEGIN call set_global_prefs(pname, pval); END; PROCEDURE set_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_SCHEMA_PREFS); PROCEDURE set_table_prefs( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_TABLE_PREFS); FUNCTION get_prefs ( pname VARCHAR(65535), ownname VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ) RETURN VARCHAR(65535); PRAGMA INTERFACE(C, GET_PREFS); FUNCTION get_param ( pname VARCHAR(65535) )RETURN VARCHAR(65535) BEGIN RETURN dbms_stats.get_prefs(pname); END; PROCEDURE delete_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535) ); PRAGMA INTERFACE(C, DELETE_SCHEMA_PREFS); PROCEDURE delete_table_prefs ( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535) ); PRAGMA INTERFACE(C, DELETE_TABLE_PREFS); PROCEDURE copy_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), srcpartname VARCHAR(65535), dstpartname VARCHAR(65535), scale_factor DECIMAL(20, 10) DEFAULT 1, flags DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, COPY_TABLE_STATS); PROCEDURE cancel_gather_stats ( taskid VARCHAR(65535) ); PRAGMA INTERFACE(C, CANCEL_GATHER_STATS); PROCEDURE GATHER_SYSTEM_STATS(); PRAGMA INTERFACE(C, GATHER_SYSTEM_STATS); PROCEDURE DELETE_SYSTEM_STATS(); PRAGMA INTERFACE(C, DELETE_SYSTEM_STATS); PROCEDURE SET_SYSTEM_STATS ( pname VARCHAR(65535), pvalue DECIMAL(20, 10) ); PRAGMA INTERFACE(C, SET_SYSTEM_STATS); PROCEDURE async_gather_stats_job_proc (duration BIGINT DEFAULT NULL); PRAGMA INTERFACE(C, ASYNC_GATHER_STATS_JOB_PROC); END dbms_stats", comment:"", route_sql:""}) [2025-04-21 14:09:56.045586] INFO [SHARE.SCHEMA] retrieve_package_schema (ob_schema_retrieve_utils.ipp:3340) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=36] retrieve all package schemas succeed(schema_array=[{tenant_id:1, database_id:201001, owner_id:200001, package_id:310052, package_name:"dbms_stats", schema_version:1745214003275840, type:2, flag:4, comp_flag:1, exec_env:"4194304,45,45,45,", source:"PACKAGE BODY dbms_stats PROCEDURE gather_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE, hist_est_percent DECIMAL DEFAULT AUTO_SAMPLE_SIZE, hist_block_sample BOOLEAN DEFAULT NULL ); PRAGMA INTERFACE(C, GATHER_TABLE_STATS); PROCEDURE gather_schema_stats ( ownname VARCHAR(65535), estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, block_sample BOOLEAN DEFAULT NULL, method_opt VARCHAR(65535) DEFAULT DEFAULT_METHOD_OPT, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, cascade BOOLEAN DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'DATA', force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, GATHER_SCHEMA_STATS); PROCEDURE gather_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, estimate_percent DECIMAL(20, 10) DEFAULT AUTO_SAMPLE_SIZE, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT NULL, granularity VARCHAR(65535) DEFAULT DEFAULT_GRANULARITY, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, GATHER_INDEX_STATS); PROCEDURE set_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numblks DECIMAL(20, 10) DEFAULT NULL, avgrlen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL ); PRAGMA INTERFACE(C, SET_TABLE_STATS); PROCEDURE set_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, distcnt DECIMAL(20, 10) DEFAULT NULL, density DECIMAL(20, 10) DEFAULT NULL, nullcnt DECIMAL(20, 10) DEFAULT NULL, epc DECIMAL(20, 10) DEFAULT NULL, minval TEXT DEFAULT NULL, maxval TEXT DEFAULT NULL, bkvals TEXT DEFAULT NULL, novals TEXT DEFAULT NULL, chvals TEXT DEFAULT NULL, eavals TEXT DEFAULT NULL, rpcnts TEXT DEFAULT NULL, eavs DECIMAL(20, 10) DEFAULT NULL, avgclen DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, SET_COLUMN_STATS); PROCEDURE set_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, numrows DECIMAL(20, 10) DEFAULT NULL, numlblks DECIMAL(20, 10) DEFAULT NULL, numdist DECIMAL(20, 10) DEFAULT NULL, avglblk DECIMAL(20, 10) DEFAULT NULL, avgdblk DECIMAL(20, 10) DEFAULT NULL, clstfct DECIMAL(20, 10) DEFAULT NULL, indlevel DECIMAL(20, 10) DEFAULT NULL, flags DECIMAL(20, 10) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, guessq DECIMAL(20, 10) DEFAULT NULL, cachedblk DECIMAL(20, 10) DEFAULT NULL, cachehit DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE, avgrlen DECIMAL(20, 10) DEFAULT NULL, nummacroblks DECIMAL(20, 10) DEFAULT NULL, nummicroblks DECIMAL(20, 10) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, SET_INDEX_STATS); PROCEDURE delete_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, cascade_columns BOOLEAN DEFAULT TRUE, cascade_indexes BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_TABLE_STATS); PROCEDURE delete_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, col_stat_type VARCHAR(65535) DEFAULT 'ALL', degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_COLUMN_STATS); procedure delete_index_stats( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, cascade_parts BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, stattype VARCHAR(65535) DEFAULT 'ALL', force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_INDEX_STATS); PROCEDURE delete_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535) DEFAULT NULL, statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, degree DECIMAL(20, 10) DEFAULT 1 ); PRAGMA INTERFACE(C, DELETE_SCHEMA_STATS); PROCEDURE FLUSH_DATABASE_MONITORING_INFO(); PRAGMA INTERFACE(C, FLUSH_DATABASE_MONITORING_INFO); PROCEDURE GATHER_DATABASE_STATS_JOB_PROC(duration BIGINT DEFAULT NULL); PRAGMA INTERFACE(C, GATHER_DATABASE_STATS_JOB_PROC); PROCEDURE create_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535), tblspace VARCHAR(65535) DEFAULT NULL, global_temporary BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, CREATE_STAT_TABLE); PROCEDURE drop_stat_table( ownname VARCHAR(65535), stattab VARCHAR(65535) ); PRAGMA INTERFACE(C, DROP_STAT_TABLE); PROCEDURE export_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PRAGMA INTERFACE(C, EXPORT_TABLE_STATS); PROCEDURE export_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_COLUMN_STATS); PROCEDURE export_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_SCHEMA_STATS); PROCEDURE export_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, EXPORT_INDEX_STATS); PROCEDURE import_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, cascade BOOLEAN DEFAULT TRUE, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, stat_category VARCHAR(65535) DEFAULT DEFAULT_STAT_CATEGORY ); PRAGMA INTERFACE(C, IMPORT_TABLE_STATS); PROCEDURE import_column_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), colname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, IMPORT_COLUMN_STATS); PROCEDURE import_schema_stats ( ownname VARCHAR(65535), stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, IMPORT_SCHEMA_STATS); PROCEDURE import_index_stats ( ownname VARCHAR(65535), indname VARCHAR(65535), partname VARCHAR(65535) DEFAULT NULL, stattab VARCHAR(65535), statid VARCHAR(65535) DEFAULT NULL, statown VARCHAR(65535) DEFAULT NULL, no_invalidate BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, tabname VARCHAR(65535) DEFAULT NULL ); PRAGMA INTERFACE(C, IMPORT_INDEX_STATS); PROCEDURE lock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, LOCK_TABLE_STATS); PROCEDURE lock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PRAGMA INTERFACE(C, LOCK_PARTITION_STATS); PROCEDURE lock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, LOCK_SCHEMA_STATS); PROCEDURE unlock_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), stattype VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, UNLOCK_TABLE_STATS); PROCEDURE unlock_partition_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), partname VARCHAR(65535) ); PRAGMA INTERFACE(C, UNLOCK_PARTITION_STATS); PROCEDURE unlock_schema_stats( ownname VARCHAR(65535), STATTYPE VARCHAR(65535) DEFAULT 'ALL' ); PRAGMA INTERFACE(C, UNLOCK_SCHEMA_STATS); PROCEDURE restore_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), as_of_timestamp DATETIME(6), restore_cluster_index BOOLEAN DEFAULT FALSE, force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, RESTORE_TABLE_STATS); PROCEDURE restore_schema_stats ( ownname VARCHAR(65535), as_of_timestamp DATETIME(6), force BOOLEAN DEFAULT FALSE, no_invalidate BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, RESTORE_SCHEMA_STATS); PROCEDURE purge_stats( before_timestamp DATETIME(6) ); PRAGMA INTERFACE(C, PURGE_STATS); PROCEDURE alter_stats_history_retention( retention DECIMAL(20, 10) ); PRAGMA INTERFACE(C, ALTER_STATS_HISTORY_RETENTION); FUNCTION get_stats_history_availability() RETURN DATETIME(6); PRAGMA INTERFACE(C, GET_STATS_HISTORY_AVAILABILITY); FUNCTION get_stats_history_retention() RETURN DECIMAL; PRAGMA INTERFACE(C, GET_STATS_HISTORY_RETENTION); PROCEDURE reset_global_pref_defaults(); PRAGMA INTERFACE(C, RESET_GLOBAL_PREF_DEFAULTS); PROCEDURE reset_param_defaults() BEGIN call reset_global_pref_defaults(); END; PROCEDURE set_global_prefs( pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_GLOBAL_PREFS); PROCEDURE set_param(pname VARCHAR(65535), pval VARCHAR(65535)) BEGIN call set_global_prefs(pname, pval); END; PROCEDURE set_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_SCHEMA_PREFS); PROCEDURE set_table_prefs( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535), pvalue VARCHAR(65535) ); PRAGMA INTERFACE(C, SET_TABLE_PREFS); FUNCTION get_prefs ( pname VARCHAR(65535), ownname VARCHAR(65535) DEFAULT NULL, tabname VARCHAR(65535) DEFAULT NULL ) RETURN VARCHAR(65535); PRAGMA INTERFACE(C, GET_PREFS); FUNCTION get_param ( pname VARCHAR(65535) )RETURN VARCHAR(65535) BEGIN RETURN dbms_stats.get_prefs(pname); END; PROCEDURE delete_schema_prefs( ownname VARCHAR(65535), pname VARCHAR(65535) ); PRAGMA INTERFACE(C, DELETE_SCHEMA_PREFS); PROCEDURE delete_table_prefs ( ownname VARCHAR(65535), tabname VARCHAR(65535), pname VARCHAR(65535) ); PRAGMA INTERFACE(C, DELETE_TABLE_PREFS); PROCEDURE copy_table_stats ( ownname VARCHAR(65535), tabname VARCHAR(65535), srcpartname VARCHAR(65535), dstpartname VARCHAR(65535), scale_factor DECIMAL(20, 10) DEFAULT 1, flags DECIMAL(20, 10) DEFAULT NULL, force BOOLEAN DEFAULT FALSE ); PRAGMA INTERFACE(C, COPY_TABLE_STATS); PROCEDURE cancel_gather_stats ( taskid VARCHAR(65535) ); PRAGMA INTERFACE(C, CANCEL_GATHER_STATS); PROCEDURE GATHER_SYSTEM_STATS(); PRAGMA INTERFACE(C, GATHER_SYSTEM_STATS); PROCEDURE DELETE_SYSTEM_STATS(); PRAGMA INTERFACE(C, DELETE_SYSTEM_STATS); PROCEDURE SET_SYSTEM_STATS ( pname VARCHAR(65535), pvalue DECIMAL(20, 10) ); PRAGMA INTERFACE(C, SET_SYSTEM_STATS); PROCEDURE async_gather_stats_job_proc (duration BIGINT DEFAULT NULL); PRAGMA INTERFACE(C, ASYNC_GATHER_STATS_JOB_PROC); END dbms_stats", comment:"", route_sql:""}]) [2025-04-21 14:09:56.045660] INFO [SHARE.SCHEMA] get_batch_packages (ob_schema_service_sql_impl.cpp:4059) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=27] get batch package info finish(schema_version=1745214003275840, ret=0) [2025-04-21 14:09:56.045723] INFO [PL] get_package_from_plan_cache (ob_pl_package_manager.cpp:1792) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=20] get pl package from plan cache failed(ret=-5138, package_id=310001) [2025-04-21 14:09:56.050045] INFO [PL] compile_module (ob_llvm_helper.cpp:625) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=19] ================Optimized LLVM Module================ [2025-04-21 14:09:56.050512] INFO [PL] dump_module (ob_llvm_helper.cpp:644) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=34] Dump LLVM Compile Module! (s.str().c_str()="; ModuleID = 'PL/SQL' source_filename = "PL/SQL" target datalayout = "e-m:e-p270:32:32-p271:32:32-p272:64:64-i64:64-f80:128-n8:16:32:64-S128" %pl_exec_context = type { i64, i64, i64, %seg_param_store*, %obj*, i32*, i64, i8, i64 } %seg_param_store = type { i64, i32, %wrapper_allocator, %seg_pointer_array, i64, i64 } %wrapper_allocator = type { i64, i64 } %seg_pointer_array = type { i64, [1 x i64]*, i64, [1 x i64], i64, i64, i64, i32, %wrapper_allocator, i8, %memory_context } %memory_context = type { i64, i64, i64 } %obj = type { %obj_meta, i32, i64 } %obj_meta = type { i8, i8, i8, i8 } %objparam = type { %obj, i64, i32, %obj.0, i32, i32, %obj_meta } %obj.0 = type { i64, i8 } %data_type = type { %obj_meta, i64, i32, i8, i8 } %unwind_exception = type { i64 } %pl_condition_value = type { i64, i64, i8*, i64, i64, i8 } declare i32 @spi_calc_expr_at_idx(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_calc_package_expr(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_convert_objparam(%pl_exec_context*, %objparam*, i64, %objparam*, i8) declare i32 @spi_set_variable_to_expr(%pl_exec_context*, i64, %objparam*, i8, i8) declare i32 @spi_query_into_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_end_trans(%pl_exec_context*, i8*, i8) declare i32 @spi_update_location(%pl_exec_context*, i64) declare i32 @spi_execute_with_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8, i8) declare i32 @spi_execute_immediate(%pl_exec_context*, i64, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_alloc_complex_var(%pl_exec_context*, i8, i64, i64, i32, i64*) declare i32 @spi_construct_collection(%pl_exec_context*, i64, %objparam*) declare i32 @spi_clear_diagnostic_area(%pl_exec_context*) declare i32 @spi_extend_collection(%pl_exec_context*, i64, i64, i64, i64, i64) declare i32 @spi_delete_collection(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_trim_collection(%pl_exec_context*, i64, i64, i64) declare i32 @spi_cursor_init(%pl_exec_context*, i64) declare i32 @spi_cursor_open_with_param_idx(%pl_exec_context*, i8*, i8*, i64, i8, i8, i64*, i64, i64, i64, i64, i64*, i64*, i64, i8) declare i32 @spi_dynamic_open(%pl_exec_context*, i64, i64*, i64, i64, i64, i64) declare i32 @spi_cursor_fetch(%pl_exec_context*, i64, i64, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i64, %data_type*, i64, i8) declare i32 @spi_cursor_close(%pl_exec_context*, i64, i64, i64, i8) declare i32 @spi_destruct_collection(%pl_exec_context*, i64) declare i32 @spi_reset_collection(i64) declare i32 @spi_sub_nestedtable(%pl_exec_context*, i64, i64, i32, i32) declare i32 @spi_copy_datum(%pl_exec_context*, i64, %obj*, %obj*, %data_type*, i64) declare i32 @spi_destruct_obj(%pl_exec_context*, %obj*) declare i32 @spi_set_pl_exception_code(%pl_exec_context*, i64, i8, i32) declare i32 @spi_get_pl_exception_code(%pl_exec_context*, i64*) declare i32 @spi_raise_application_error(%pl_exec_context*, i64, i64) declare i32 @spi_check_early_exit(%pl_exec_context*) declare i32 @spi_pipe_row_to_result(%pl_exec_context*, %objparam*) declare i32 @spi_check_exception_handler_legal(%pl_exec_context*, i64) declare i32 @spi_interface_impl(%pl_exec_context*, i8*) declare i32 @spi_process_nocopy_params(%pl_exec_context*, i64) declare i32 @spi_add_ref_cursor_refcount(%pl_exec_context*, %obj*, i64) declare i32 @spi_handle_ref_cursor_refcount(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_update_package_change_info(%pl_exec_context*, i64, i64) declare i32 @spi_check_composite_not_null(%objparam*) declare i32 @spi_process_resignal(%pl_exec_context*, i64, i64, i8*, i64*, i8*, i8) declare i32 @spi_check_autonomous_trans(%pl_exec_context*) declare i32 @spi_opaque_assign_null(i64) declare i32 @spi_pl_profiler_before_record(%pl_exec_context*, i64, i64) declare i32 @spi_pl_profiler_after_record(%pl_exec_context*, i64, i64) declare %unwind_exception* @eh_create_exception(i64, i64, i64, i64, %pl_condition_value*) declare i32 @_Unwind_RaiseException(%unwind_exception*) declare void @_Unwind_Resume(%unwind_exception*) declare i32 @eh_personality(i32, i32, i64, i8, i8) declare i32 @eh_convert_exception(i8, i32, i64*, i64*, i8**, i64*) declare i64 @eh_classify_exception(i8*) declare void @eh_debug_int64(i8*, i64, i64) declare void @eh_debug_int64ptr(i8*, i64, i64*) declare void @eh_debug_int32(i8*, i64, i32) declare void @eh_debug_int32ptr(i8*, i64, i32*) declare void @eh_debug_int8(i8*, i64, i8) declare void @eh_debug_int8ptr(i8*, i64, i8*) declare void @eh_debug_obj(i8*, i64, %obj*) declare void @eh_debug_objparam(i8*, i64, %objparam*) declare i32 @pl_execute(%pl_exec_context*, i64, i64, i64*, i64, i64, i64, i64, i64*, i64) declare i32 @set_user_type_var(%pl_exec_context*, i64, i64, i32) declare i32 @set_implicit_cursor_in_forall(%pl_exec_context*, i8) declare i32 @unset_implicit_cursor_in_forall(%pl_exec_context*) ") [2025-04-21 14:09:56.055550] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:528}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:56.057708] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=45] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:528}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:56.057810] INFO [PL.STORAGEROUTINE] read_dll_from_disk (ob_pl_persistent.cpp:467) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=37] succ decode dll from disk(ret=0, key_id_=310001, merge_version=1745214621808192) [2025-04-21 14:09:56.061472] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=29] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:297}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:56.062372] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=44] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:101063}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:56.063975] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=40] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:297}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:56.067775] INFO [STORAGE] check_status_for_new_mds (ob_tablet_create_delete_helper.cpp:263) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=41] refresh tablet status cache(ret=0, ls_id={id:1}, tablet_id={id:272}, tablet_status_cache={tablet_status:{val:1, str:"NORMAL"}, create_commit_version:1745213983259198000, delete_commit_version:-1}, snapshot_version=9223372036854775807) [2025-04-21 14:09:56.069747] INFO [STORAGE] check_snapshot_readable_with_cache (ob_tablet.cpp:8250) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=44] refresh ddl data cache(ret=0, ls_id={id:1}, tablet_id={id:272}, ddl_data_cache_={redefined:false, schema_version:0, snapshot_version:0}) [2025-04-21 14:09:56.069945] INFO [PL] compile_package (ob_pl_compile.cpp:943) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=41] >>>>>>>>Final Compile Package Time: (package.get_id()=310001, package.get_name()=dbms_stats, compile_end - compile_start=23273) [2025-04-21 14:09:56.070039] INFO [PL] add_package_to_plan_cache (ob_pl_package_manager.cpp:1739) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=34] add pl package to plan cache success(ret=0, package_id=310001, package->get_dependency_table()=[cnt:1, {table_id:310001, schema_version:1745214002349608, object_type:7, is_db_explicit:false, is_existed:true}], pc_ctx.key_={db_id:201001, key_id:310001, namespace:6, name:""}) [2025-04-21 14:09:56.070126] INFO [PL] get_package_from_plan_cache (ob_pl_package_manager.cpp:1792) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=33] get pl package from plan cache failed(ret=-5138, package_id=310052) [2025-04-21 14:09:56.084557] INFO [PALF] runTimerTask (block_gc_timer_task.cpp:101) [620222][T1002_PalfGC][T1002][Y0-0000000000000000-0-0] [lt=62] BlockGCTimerTask success(ret=0, cost_time_us=45, palf_env_impl_={IPalfEnvImpl:{IPalfEnvImpl:"Dummy"}, self:"11.29.122.182:2882", log_dir:"/home/oceanbase/tianxing/oceanbase/store/clog/tenant_1002", disk_options_wrapper:{disk_opts_for_stopping_writing:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, disk_opts_for_recycling_blocks:{log_disk_size(MB):5529, log_disk_utilization_threshold(%):80, log_disk_utilization_limit_threshold(%):95, log_disk_throttling_percentage(%):60, log_disk_throttling_maximum_duration(s):7200, log_writer_parallelism:3}, status:1, cur_unrecyclable_log_disk_size(MB):153, sequence:1}, log_alloc_mgr_:{flying_log_task:0, flying_meta_task:0}}) [2025-04-21 14:09:56.090747] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04D6-0-0] [lt=32][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:56.095160] WDIAG begin (ob_hashtable.h:954) [620345][T1002_L0_G0][T1002][YB420B1D7AB6-00063343B76F04D7-0-0] [lt=2068][errcode=-4006] hashtable not init, backtrace=0x7bad295 0x11d2e944 0x11b0fd3e 0x1074849e 0x7b9860c 0x13031cf9 0x77d53af 0x7614709 0x75165a9 0x7513e7c 0x76d08cb 0x74bd4a8 0x74ae4c5 0x74a6bfc 0x74a508f 0x7495da3 0xea134c9 0x1ec8211e 0x7f3ca38081cf 0x7f3ca3439ea3 [2025-04-21 14:09:56.104262] INFO [PL] compile_module (ob_llvm_helper.cpp:625) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=21] ================Optimized LLVM Module================ [2025-04-21 14:09:56.105422] INFO [PL] dump_module (ob_llvm_helper.cpp:644) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=663] Dump LLVM Compile Module! (s.str().c_str()="; ModuleID = 'PL/SQL' source_filename = "PL/SQL" target datalayout = "e-m:e-p270:32:32-p271:32:32-p272:64:64-i64:64-f80:128-n8:16:32:64-S128" %pl_exec_context = type { i64, i64, i64, %seg_param_store*, %obj*, i32*, i64, i8, i64 } %seg_param_store = type { i64, i32, %wrapper_allocator, %seg_pointer_array, i64, i64 } %wrapper_allocator = type { i64, i64 } %seg_pointer_array = type { i64, [1 x i64]*, i64, [1 x i64], i64, i64, i64, i32, %wrapper_allocator, i8, %memory_context } %memory_context = type { i64, i64, i64 } %obj = type { %obj_meta, i32, i64 } %obj_meta = type { i8, i8, i8, i8 } %objparam = type { %obj, i64, i32, %obj.0, i32, i32, %obj_meta } %obj.0 = type { i64, i8 } %data_type = type { %obj_meta, i64, i32, i8, i8 } %unwind_exception = type { i64 } %pl_condition_value = type { i64, i64, i8*, i64, i64, i8 } declare i32 @spi_calc_expr_at_idx(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_calc_package_expr(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_convert_objparam(%pl_exec_context*, %objparam*, i64, %objparam*, i8) declare i32 @spi_set_variable_to_expr(%pl_exec_context*, i64, %objparam*, i8, i8) declare i32 @spi_query_into_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_end_trans(%pl_exec_context*, i8*, i8) declare i32 @spi_update_location(%pl_exec_context*, i64) declare i32 @spi_execute_with_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8, i8) declare i32 @spi_execute_immediate(%pl_exec_context*, i64, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_alloc_complex_var(%pl_exec_context*, i8, i64, i64, i32, i64*) declare i32 @spi_construct_collection(%pl_exec_context*, i64, %objparam*) declare i32 @spi_clear_diagnostic_area(%pl_exec_context*) declare i32 @spi_extend_collection(%pl_exec_context*, i64, i64, i64, i64, i64) declare i32 @spi_delete_collection(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_trim_collection(%pl_exec_context*, i64, i64, i64) declare i32 @spi_cursor_init(%pl_exec_context*, i64) declare i32 @spi_cursor_open_with_param_idx(%pl_exec_context*, i8*, i8*, i64, i8, i8, i64*, i64, i64, i64, i64, i64*, i64*, i64, i8) declare i32 @spi_dynamic_open(%pl_exec_context*, i64, i64*, i64, i64, i64, i64) declare i32 @spi_cursor_fetch(%pl_exec_context*, i64, i64, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i64, %data_type*, i64, i8) declare i32 @spi_cursor_close(%pl_exec_context*, i64, i64, i64, i8) declare i32 @spi_destruct_collection(%pl_exec_context*, i64) declare i32 @spi_reset_collection(i64) declare i32 @spi_sub_nestedtable(%pl_exec_context*, i64, i64, i32, i32) declare i32 @spi_copy_datum(%pl_exec_context*, i64, %obj*, %obj*, %data_type*, i64) declare i32 @spi_destruct_obj(%pl_exec_context*, %obj*) declare i32 @spi_set_pl_exception_code(%pl_exec_context*, i64, i8, i32) declare i32 @spi_get_pl_exception_code(%pl_exec_context*, i64*) declare i32 @spi_raise_application_error(%pl_exec_context*, i64, i64) declare i32 @spi_check_early_exit(%pl_exec_context*) declare i32 @spi_pipe_row_to_result(%pl_exec_context*, %objparam*) declare i32 @spi_check_exception_handler_legal(%pl_exec_context*, i64) declare i32 @spi_interface_impl(%pl_exec_context*, i8*) declare i32 @spi_process_nocopy_params(%pl_exec_context*, i64) declare i32 @spi_add_ref_cursor_refcount(%pl_exec_context*, %obj*, i64) declare i32 @spi_handle_ref_cursor_refcount(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_update_package_change_info(%pl_exec_context*, i64, i64) declare i32 @spi_check_composite_not_null(%objparam*) declare i32 @spi_process_resignal(%pl_exec_context*, i64, i64, i8*, i64*, i8*, i8) declare i32 @spi_check_autonomous_trans(%pl_exec_context*) declare i32 @spi_opaque_assign_null(i64) declare i32 @spi_pl_profiler_before_record(%pl_exec_context*, i64, i64) declare i32 @spi_pl_profiler_after_record(%pl_exec_context*, i64, i64) declare %unwind_exception* @eh_create_exception(i64, i64, i64, i64, %pl_condition_value*) declare i32 @_Unwind_RaiseException(%unwind_exception*) declare void @_Unwind_Resume(%unwind_exception*) declare i32 @eh_personality(i32, i32, i64, i8, i8) declare i32 @eh_convert_exception(i8, i32, i64*, i64*, i8**, i64*) declare i64 @eh_classify_exception(i8*) declare void @eh_debug_int64(i8*, i64, i64) declare void @eh_debug_int64ptr(i8*, i64, i64*) declare void @eh_debug_int32(i8*, i64, i32) declare void @eh_debug_int32ptr(i8*, i64, i32*) declare void @eh_debug_int8(i8*, i64, i8) declare void @eh_debug_int8ptr(i8*, i64, i8*) declare void @eh_debug_obj(i8*, i64, %obj*) declare void @eh_debug_objparam(i8*, i64, %objparam*) declare i32 @pl_execute(%pl_exec_context*, i64, i64, i64*, i64, i64, i64, i64, i64*, i64) declare i32 @set_user_type_var(%pl_exec_context*, i64, i64, i32) declare i32 @set_implicit_cursor_in_forall(%pl_exec_context*, i8) declare i32 @unset_implicit_cursor_in_forall(%pl_exec_context*) ") [2025-04-21 14:09:56.104868] INFO [SERVER] runTimerTask (ob_eliminate_task.cpp:225) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=20] sql audit evict task end(request_manager_->get_tenant_id()=1002, evict_high_mem_level=16106127, evict_high_size_level=471859, evict_batch_count=0, elapse_time=1, size_used=0, mem_used=8318976) [2025-04-21 14:09:56.105558] INFO [SERVER] prepare_alloc_queue (ob_dl_queue.cpp:52) [620302][T1002_ReqMemEvi][T1002][Y0-0000000000000000-0-0] [lt=679] Construct Queue Num(construct_num=0, get_push_idx()=8, get_cur_idx()=0, get_pop_idx()=0) [2025-04-21 14:09:56.106256] INFO eloop_run (eloop.c:140) [619530][pnio1][T0][Y0-0000000000000000-0-0] [lt=48] PNIO [ratelimit] time: 1745215796106251, bytes: 5544039, bw: 0.012991 MB/s, add_ts: 1007637, add_bytes: 13726 [2025-04-21 14:09:56.107199] WDIAG [STORAGE.TRANS] run1 (ob_standby_timestamp_service.cpp:147) [620301][T1002_STSWorker][T1002][Y0-0000000000000000-0-0] [lt=37][errcode=-4076] query and update last id fail(ret=-4076, ret="OB_NEED_WAIT") [2025-04-21 14:09:56.115222] INFO [PL] compile_module (ob_llvm_helper.cpp:625) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=30] ================Optimized LLVM Module================ [2025-04-21 14:09:56.116201] INFO [PL] dump_module (ob_llvm_helper.cpp:644) [620042][T1_L0_G0][T1][YB420B1D7AB6-00063343B18EFDFD-0-0] [lt=36] Dump LLVM Compile Module! (s.str().c_str()="; ModuleID = 'PL/SQL' source_filename = "PL/SQL" target datalayout = "e-m:e-p270:32:32-p271:32:32-p272:64:64-i64:64-f80:128-n8:16:32:64-S128" %pl_exec_context = type { i64, i64, i64, %seg_param_store*, %obj*, i32*, i64, i8, i64 } %seg_param_store = type { i64, i32, %wrapper_allocator, %seg_pointer_array, i64, i64 } %wrapper_allocator = type { i64, i64 } %seg_pointer_array = type { i64, [1 x i64]*, i64, [1 x i64], i64, i64, i64, i32, %wrapper_allocator, i8, %memory_context } %memory_context = type { i64, i64, i64 } %obj = type { %obj_meta, i32, i64 } %obj_meta = type { i8, i8, i8, i8 } %objparam = type { %obj, i64, i32, %obj.0, i32, i32, %obj_meta } %obj.0 = type { i64, i8 } %data_type = type { %obj_meta, i64, i32, i8, i8 } %unwind_exception = type { i64 } %pl_condition_value = type { i64, i64, i8*, i64, i64, i8 } declare i32 @spi_calc_expr_at_idx(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_calc_package_expr(%pl_exec_context*, i64, i64, %objparam*) declare i32 @spi_convert_objparam(%pl_exec_context*, %objparam*, i64, %objparam*, i8) declare i32 @spi_set_variable_to_expr(%pl_exec_context*, i64, %objparam*, i8, i8) declare i32 @spi_query_into_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_end_trans(%pl_exec_context*, i8*, i8) declare i32 @spi_update_location(%pl_exec_context*, i64) declare i32 @spi_execute_with_expr_idx(%pl_exec_context*, i8*, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8, i8) declare i32 @spi_execute_immediate(%pl_exec_context*, i64, i64, i64*, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i8, i8) declare i32 @spi_alloc_complex_var(%pl_exec_context*, i8, i64, i64, i32, i64*) declare i32 @spi_construct_collection(%pl_exec_context*, i64, %objparam*) declare i32 @spi_clear_diagnostic_area(%pl_exec_context*) declare i32 @spi_extend_collection(%pl_exec_context*, i64, i64, i64, i64, i64) declare i32 @spi_delete_collection(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_trim_collection(%pl_exec_context*, i64, i64, i64) declare i32 @spi_cursor_init(%pl_exec_context*, i64) declare i32 @spi_cursor_open_with_param_idx(%pl_exec_context*, i8*, i8*, i64, i8, i8, i64*, i64, i64, i64, i64, i64*, i64*, i64, i8) declare i32 @spi_dynamic_open(%pl_exec_context*, i64, i64*, i64, i64, i64, i64) declare i32 @spi_cursor_fetch(%pl_exec_context*, i64, i64, i64, i64*, i64, %data_type*, i64, i8*, i64*, i8, i64, %data_type*, i64, i8) declare i32 @spi_cursor_close(%pl_exec_context*, i64, i64, i64, i8) declare i32 @spi_destruct_collection(%pl_exec_context*, i64) declare i32 @spi_reset_collection(i64) declare i32 @spi_sub_nestedtable(%pl_exec_context*, i64, i64, i32, i32) declare i32 @spi_copy_datum(%pl_exec_context*, i64, %obj*, %obj*, %data_type*, i64) declare i32 @spi_destruct_obj(%pl_exec_context*, %obj*) declare i32 @spi_set_pl_exception_code(%pl_exec_context*, i64, i8, i32) declare i32 @spi_get_pl_exception_code(%pl_exec_context*, i64*) declare i32 @spi_raise_application_error(%pl_exec_context*, i64, i64) declare i32 @spi_check_early_exit(%pl_exec_context*) declare i32 @spi_pipe_row_to_result(%pl_exec_context*, %objparam*) declare i32 @spi_check_exception_handler_legal(%pl_exec_context*, i64) declare i32 @spi_interface_impl(%pl_exec_context*, i8*) declare i32 @spi_process_nocopy_params(%pl_exec_context*, i64) declare i32 @spi_add_ref_cursor_refcount(%pl_exec_context*, %obj*, i64) declare i32 @spi_handle_ref_cursor_refcount(%pl_exec_context*, i64, i64, i64, i64) declare i32 @spi_update_package_change_info(%pl_exec_context*, i64, i64) declare i32 @spi_check_composite_not_null(%objparam*) declare i32 @spi_process_resignal(%pl_exec_context*, i64, i64, i8*, i64*, i8*, i8) declare i32 @spi_check_autonomous_trans(%pl_exec_context*) declare i32 @spi_opaque_assign_null(i64) declare i32 @spi_pl_profiler_before_record(%pl_exec_context*, i64, i64) declare i32 @spi_pl_profiler_after_record(%pl_exec_context*, i64, i64) declare %unwind_exception* @eh_create_exception(i64, i64, i64, i64, %pl_condition_value*) declare i32 @_Unwind_RaiseException(%unwind_exception*) declare void @_Unwind_Resume(%unwind_exception*) declare i32 @eh_personality(i32, i32, i64, i8, i8) declare i32 @eh_convert_exception(i8, i32, i64*, i64*, i8**, i64*) declare i64 @eh_classify_exception(i8*) declare void @eh_debug_int64(i8*, i64, i64) declare void @eh_debug_int64ptr(i8*, i64, i64*) declare void @eh_debug_int32(i8*, i64, i32) declare void @eh_debug_int32ptr(i8*, i64, i32*) declare void @eh_debug_int8(i8*, i64, i8) declare void @eh_debug_int8ptr(i8*, i64, i8*) declare void @eh_debug_obj(i8*, i64, %obj*) declare void @eh_debug_objparam(i8*, i64, %objparam*) declare i32 @pl_execute(%pl_exec_context*, i64, i64, i64*, i64, i64, i64, i64, i64*, i64) declare i32 @set_user_type_var(%pl_exec_context*, i64, i64, i32) declare i32 @set_implicit_cursor_in_forall(%pl_exec_context*, i8) declare i32 @unset_implicit_cursor_in_forall(%pl_exec_context*) define i32 @gather_table_stats(%pl_exec_context* %__hidden_exec_ctx__, i64 %__argc__, [17 x i64]* %__argv__) personality i32 (i32, i32, i64, i8, i8)* @eh_personality { entry: %int_alloca = alloca i32, align 4 store i32 0, i32* %int_alloca, align 4 %stmt_id = alloca i64, align 8 %string = alloca [19 x i8], align 1 %string.repack = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 0 store i8 71, i8* %string.repack, align 1 %string.repack314 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 1 store i8 65, i8* %string.repack314, align 1 %string.repack315 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 2 store i8 84, i8* %string.repack315, align 1 %string.repack316 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 3 store i8 72, i8* %string.repack316, align 1 %string.repack317 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 4 store i8 69, i8* %string.repack317, align 1 %string.repack318 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 5 store i8 82, i8* %string.repack318, align 1 %string.repack319 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 6 store i8 95, i8* %string.repack319, align 1 %string.repack320 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 7 store i8 84, i8* %string.repack320, align 1 %string.repack321 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 8 store i8 65, i8* %string.repack321, align 1 %string.repack322 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 9 store i8 66, i8* %string.repack322, align 1 %string.repack323 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 10 store i8 76, i8* %string.repack323, align 1 %string.repack324 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 11 store i8 69, i8* %string.repack324, align 1 %string.repack325 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 12 store i8 95, i8* %string.repack325, align 1 %string.repack326 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 13 store i8 83, i8* %string.repack326, align 1 %string.repack327 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 14 store i8 84, i8* %string.repack327, align 1 %string.repack328 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 15 store i8 65, i8* %string.repack328, align 1 %string.repack329 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 16 store i8 84, i8* %string.repack329, align 1 %string.repack330 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 17 store i8 83, i8* %string.repack330, align 1 %string.repack331 = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 18 store i8 0, i8* %string.repack331, align 1 %string_to_char = getelementptr inbounds [19 x i8], [19 x i8]* %string, i64 0, i64 0 %spi_interface_impl = call i32 @spi_interface_impl(%pl_exec_context* %__hidden_exec_ctx__, i8* nonnull %string_to_char) store i32 %spi_interface_impl, i32* %int_alloca, align 4 store i64 0, i64* %stmt_id, align 8 %0 = icmp eq i32 %spi_interface_impl, 0 br i1 %0, label %ob_success, label %ob_fail ob_success: ; preds = %normal_raise_block, %entry %load_ret92 = load i32, i32* %int_alloca, align 4 ret i32 %load_ret92 ob_fail: ; preds = %entry %exception_type = alloca i64, align 8 %error_code = alloca i64, align 8 %sql_state = alloca i8*, align 8 %str_len = alloca i64, align 8 %load_ret = load i32, i32* %int_alloca, align 4 %line_number = load i64, i64* %stmt_id, align 8 %convert_exception = call i32 @eh_convert_exception(i8 0, i32 %load_ret, i64* nonnull %exception_type, i64* nonnull %error_code, i8** nonnull %sql_state, i64* nonnull %str_len) %load_type = load i64, i64* %exception_type, align 8 %load_error_code = load i64, i64* %error_code, align 8 %load_sql_state = load i8*, i8** %sql_state, align 8 %load_str_len = load i64, i64* %str_len, align 8 %1 = getelementptr inbounds %pl_exec_context, %pl_exec_context* %__hidden_exec_ctx__, i64 0, i32 5 %2 = load i32*, i32** %1, align 8 store i32 %load_ret, i32* %2, align 4 %3 = getelementptr inbounds %pl_exec_context, %pl_exec_context* %__hidden_exec_ctx__, i64 0, i32 8 %4 = load i64, i64* %3, align 8 %5 = getelementptr inbounds %pl_exec_context, %pl_exec_context* %__hidden_exec_ctx__, i64 0, i32 6 %6 = load i64, i64* %5, align 8 %7 = getelementptr inbounds %pl_exec_context, %pl_exec_context* %__hidden_exec_ctx__, i64 0, i32 1 %8 = load i64, i64* %7, align 8 %handler_condition = alloca %pl_condition_value, align 8 %extract_arg85 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 0 store i64 %load_type, i64* %extract_arg85, align 8 %extract_arg86 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 1 store i64 %load_error_code, i64* %extract_arg86, align 8 %extract_arg87 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 2 store i8* %load_sql_state, i8** %extract_arg87, align 8 %extract_arg88 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 3 store i64 %load_str_len, i64* %extract_arg88, align 8 %extract_arg89 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 4 store i64 %line_number, i64* %extract_arg89, align 8 %extract_arg90 = getelementptr inbounds %pl_condition_value, %pl_condition_value* %handler_condition, i64 0, i32 5 store i8 0, i8* %extract_arg90, align 8 %create_exception = call %unwind_exception* @eh_create_exception(i64 %4, i64 %6, i64 %line_number, i64 %8, %pl_condition_value* nonnull %handler_condition) switch i64 %load_error_code, label %normal_raise_block [ i64 1262, label %raise_exception i64 1265, label %raise_exception i64 1642, label %raise_exception ] raise_exception: ; preds = %normal_raise_block, %ob_fail, %ob_fail, %ob_fail %raise_exception91 = call i32 @_Unwind_RaiseException(%unwind_exception* %create_exception) unreachable normal_raise_block: ; preds = %ob_fail %get_exception_class = call i64 @eh_classify_exception(i8* %load_sql_state) %get_exception_class.off = add i64 %get_exception_class, -3 %switch = icmp ult i64 %get_exception_class.off, 2 br i1 %switch, label %ob_success, label %raise_exception } ")